OSS Radarsglang alternatives
sgl-project/sglang (37k stars, +98 this week): SGLang is a high-performance serving framework for large language models and multimodal models. Why it matters: useful plumbing for shipping LLM-powered features.
Below are 12 other LLM tooling repos tracked by OSS Radar that share at least two GitHub topics with sglang, ordered by how many topics overlap, then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.
1. vllm-project/vllm
+70/wkest.A high-throughput and memory-efficient inference and serving engine for LLMs. Why it matters: useful plumbing for shipping LLM-powered features.
94k stars · Python · shared topics: blackwell, cuda, deepseek, gpt-oss, inference, llama, llm, moe, qwen, transformer
2. ollama/ollama
+238/wkest.Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. Why it matters: useful plumbing for shipping LLM-powered features.
183k stars · Go · shared topics: deepseek, glm, gpt-oss, llama, llm, minimax, qwen
3. huggingface/transformers
+112/wkest.🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models… Why it matters: useful plumbing for shipping LLM-powered features.
168k stars · Python · shared topics: deepseek, glm, llm, qwen, transformer, vlm
4. FlashML-org/FreeToken
+35/wkest.FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently. Why it matters: useful plumbing for shipping LLM-powered features.
14k stars · Python · shared topics: glm, inference, minimax, moe, qwen, transformer
5. unslothai/unsloth
+119/wkest.Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more. Why it matters: useful plumbing for shipping LLM-powered features.
78k stars · Python · shared topics: deepseek, llama, llm, qwen, reinforcement-learning
6. hiyouga/LlamaFactory
+70/wkest.Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024). Why it matters: useful plumbing for shipping LLM-powered features.
75k stars · Python · shared topics: deepseek, llama, llm, moe, qwen
7. mw00/project-maya
+732/wkest.Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Why it matters: useful plumbing for shipping LLM-powered features.
767 stars · C++ · shared topics: cuda, glm, llm, moe
8. decolua/9router
+98/wkest.Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Why it matters: useful plumbing for shipping LLM-powered features.
31k stars · JavaScript · shared topics: deepseek, llm, qwen
9. dyad-sh/dyad
+49/wkest.Local, open-source AI app builder for power users ✨ v0 / Lovable / Replit / Bolt alternative 🌟 Star if you like it! Why it matters: useful plumbing for shipping LLM-powered features.
22k stars · TypeScript · shared topics: deepseek, llm, qwen
10. labring/FastGPT
+35/wkest.FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data… Why it matters: useful plumbing for shipping LLM-powered features.
30k stars · TypeScript · shared topics: deepseek, llm, qwen
11. jnMetaCode/agency-agents-zh
+35/wkest.🎭 277 个即插即用的 AI 专家角色 — 支持 Claude Code/Cursor/Copilot 等 20 种工具，覆盖工程/设计/营销/金融等 20 个部门。含 64 个中国市场原创智能体（小红书/抖音/微信/飞书/钉钉/Qt 上位机/机械设计）。 Why it matters: useful plumbing for shipping LLM-powered features.
21k stars · Shell · shared topics: deepseek, llm, qwen
12. Ebony-Vinyl/dsh-our-free-model
+5.3k/wkest.All you do is install this plugin in dsh: no login, no sign-up, no API key — the frontier models are just there, DeepSeek V4.1 Flash and… Why it matters: useful plumbing for shipping LLM-powered features.
15k stars · JavaScript · shared topics: deepseek, llm
More: all trending LLM tooling repos · compare sglang with the top 2