FreeToken alternatives

FlashML-org/FreeToken (14k stars, +28 this week): FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently. Why it matters: useful plumbing for shipping LLM-powered features.

Below are 6 other LLM tooling repos tracked by OSS Radar that share at least two GitHub topics with FreeToken, ordered by how many topics overlap, then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.

1. 1. sgl-project/sglang

   +77/wkest.

   SGLang is a high-performance serving framework for large language models and multimodal models. Why it matters: useful plumbing for shipping LLM-powered features.

   37k stars · Python · shared topics: glm, inference, minimax, moe, qwen, transformer

2. 2. vllm-project/vllm

   +56/wkest.

   A high-throughput and memory-efficient inference and serving engine for LLMs. Why it matters: useful plumbing for shipping LLM-powered features.

   94k stars · Python · shared topics: inference, moe, qwen, transformer

3. 3. ollama/ollama

   +168/wkest.

   Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. Why it matters: useful plumbing for shipping LLM-powered features.

   183k stars · Go · shared topics: glm, minimax, qwen

4. 4. huggingface/transformers

   +70/wkest.

   🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models… Why it matters: useful plumbing for shipping LLM-powered features.

   168k stars · Python · shared topics: glm, qwen, transformer

5. 5. mw00/project-maya

   +736/wkest.

   Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Why it matters: useful plumbing for shipping LLM-powered features.

   766 stars · C++ · shared topics: glm, moe

6. 6. hiyouga/LlamaFactory

   +49/wkest.

   Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024). Why it matters: useful plumbing for shipping LLM-powered features.

   75k stars · Python · shared topics: moe, qwen

More: all trending LLM tooling repos · compare FreeToken with the top 2