project-maya alternatives

mw00/project-maya (766 stars, +736 this week): Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Why it matters: useful plumbing for shipping LLM-powered features.

Below are 12 other LLM tooling repos tracked by OSS Radar that share at least two GitHub topics with project-maya, ordered by how many topics overlap, then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.

1. 1. sgl-project/sglang

   +77/wkest.

   SGLang is a high-performance serving framework for large language models and multimodal models. Why it matters: useful plumbing for shipping LLM-powered features.

   37k stars · Python · shared topics: cuda, glm, llm, moe

2. 2. syv-ai/HyperQwen

   +63/wkest.

   Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the… Why it matters: useful plumbing for shipping LLM-powered features.

   2k stars · Python · shared topics: cuda, llm-inference, local-llm, quantization

3. 3. bojieli/ai-infra-book

   +196/wkest.

   Open-source book that derives LLM inference and training system design from hardware limits, with calculation tools. Why it matters: useful plumbing for shipping LLM-powered features.

   6.5k stars · Python · shared topics: llm, llm-inference, mixture-of-experts

4. 4. vllm-project/vllm

   +56/wkest.

   A high-throughput and memory-efficient inference and serving engine for LLMs. Why it matters: useful plumbing for shipping LLM-powered features.

   94k stars · Python · shared topics: cuda, llm, moe

5. 5. hiyouga/LlamaFactory

   +49/wkest.

   Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024). Why it matters: useful plumbing for shipping LLM-powered features.

   75k stars · Python · shared topics: llm, moe, quantization

6. 6. amitshekhariitbhu/ai-engineering-interview-questions

   +42/wkest.

   Your Cheat Sheet for AI Engineering Interview – Questions and Answers. Why it matters: useful plumbing for shipping LLM-powered features.

   3.4k stars · Markdown · shared topics: llm, llm-inference, quantization

7. 7. YeonwooSung/llm-architecture-from-scratch

   +525/wkest.

   Implementing LLM architectures from scratch in PyTorch. Why it matters: useful plumbing for shipping LLM-powered features.

   593 stars · Python · shared topics: llm, moe

8. 8. KKKKhazix/AIHOT

   +371/wkest.

   A website framework that collects hot topics from your sources and writes daily reports for any industry. Why it matters: useful plumbing for shipping LLM-powered features.

   7.6k stars · TypeScript · shared topics: llm, self-hosted

9. 9. MakazhanAlpamys/Soup

   +315/wkest.

   Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU. Why it matters: useful plumbing for shipping LLM-powered features.

   8.9k stars · Python · shared topics: llm, local-llm

10. 10. open-webui/open-webui

    +175/wkest.

    User-friendly AI Interface (Supports Ollama, OpenAI API, ...). Why it matters: useful plumbing for shipping LLM-powered features.

    156k stars · Python · shared topics: llm, self-hosted

11. 11. ollama/ollama

    +168/wkest.

    Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. Why it matters: useful plumbing for shipping LLM-powered features.

    183k stars · Go · shared topics: glm, llm

12. 12. elie222/rakazo

    +147/wkest.

    Open-source Grok Bot alternative. Choose your own model and sandbox. Why it matters: useful plumbing for shipping LLM-powered features.

    3.9k stars · TypeScript · shared topics: llm, self-hosted

More: all trending LLM tooling repos · compare project-maya with the top 2