OSS Radar
FlashML-org/FreeToken
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently. Why it matters: useful plumbing for shipping LLM-powered features.
GitHub description: FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
Stars
14k
Last 24h
+171est.
Last 7 days
+1.2kest.
Forks
1.4k
Who it's for
Developers and power users with consumer hardware, such as gaming PCs, laptops, or workstation GPUs, who want to run large open-weight MoE models locally. It is also aimed at people who want to connect those local models to coding and tool-calling agents.
- Running frontier open-weight MoE models (290B+) locally on a gaming PC
- Serving local models to coding agents such as Claude Code, Codex, or OpenCode via Anthropic/OpenAI-compatible APIs
- Local tool-calling agent workflows with cached context reuse across agentic edits
Star history (last 1 snapshot)
Only one snapshot so far. The chart fills in as OSS Radar collects daily snapshots.
* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.
Maintainer? Add the badge to your README
Shows your live OSS Radar rank and links back here. Updates hourly.
[](https://ossradar.net/repo/FlashML-org/FreeToken)<a href="https://ossradar.net/repo/FlashML-org/FreeToken"><img src="https://ossradar.net/badge/FlashML-org/FreeToken" alt="Trending on OSS Radar"></a>About FreeToken
FlashML-org/FreeToken is a Python project in the LLM tooling category, created 3 months ago. It has 14k GitHub stars and 1.4k forks, and gained +1.2k stars over the last 7 days (early estimate), ranking #33 of 166 LLM tooling repos tracked by OSS Radar this week.
See more trending LLM tooling repos or the top AI repos this week.
- Language
- Python
- Category
- LLM tooling
- Created
- Jul 20, 2026
- Last push
- Oct 13, 2026
- deepseek-v4
- edge
- glm
- inference
- minimax
- moe
- qwen
- transformer
Similar rising repos
- sgl-project/sglang+257est.
SGLang is a high-performance serving framework for large language models and multimodal models. Why it matters: useful plumbing for shipping LLM-powered features.
- vllm-project/vllm+489est.
A high-throughput and memory-efficient inference and serving engine for LLMs. Why it matters: useful plumbing for shipping LLM-powered features.
- huggingface/transformers+404est.
Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both… Why it matters: useful plumbing for shipping LLM-powered features.
- ollama/ollama+1.1kest.
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. Why it matters: useful plumbing for shipping LLM-powered features.
- hiyouga/LlamaFactory+428est.
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024). Why it matters: useful plumbing for shipping LLM-powered features.
- FareedKhan-dev/kimi-k3-in-c+863est.
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU. Why it matters: useful plumbing for shipping LLM-powered features.