Topic
Trending GGUF GitHub repos
Repos whose maintainers tagged them gguf on GitHub (topics are labels that describe what a project is about), ranked by stars gained.
10 repos gained about 4.2k stars in the last 7 days. Leading this week: BLA (+1.5k stars), inferssd (+813) and llama-modchip (+494).
By category: Local LLMs (5), LLM tooling (4) and MCP (1).
10 repos tracked · ranked by stars gained · updated hourly
Related topics:LLMlocal LLMAI agentsClaude CodeMCPself-hostedDeepSeekCLIWindowsOllama
GGUF leaderboard
* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.
- 1qybaihe/bla
BLA (bla-agents / Blind LLM Agents) — Open-source Blue Defense MCP server & CLI protecting JS/TS, Electron ASAR, WASM, Python, Native…
MCPTypeScript★ 5.8k
+1.5k
stars this week
- 2wici-ai/inferssd
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
Local LLMsC++★ 1.2k
+813
stars this week
- 3synchopate/llama-modchip
Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB…
Local LLMsPython★ 1.3k
+494
stars this week
- 4AtomicBot-ai/atomic-agent
Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
Local LLMsTypeScript★ 3.7k
+343
stars this week
- 5huawei-csl/MACaQ
SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp…
Local LLMsC++★ 314
+314
stars this week
- 6mw00/project-maya
Run GLM-5.3 (744B), GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one…
LLM toolingC++★ 2.9k
+199
stars this week
- 7MakazhanAlpamys/Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
LLM toolingPython★ 11k
+184
stars this week
- 8AlexsJones/llmfit
Hundreds of models & providers. One command to find what runs on your hardware.
LLM toolingRust★ 39k
+145
stars this week
- 9CapriChooms/CapriCore
Capri — an AI desktop companion for Windows with local/API models, Hugging Face, optional voice, memory and permission-based desktop tools.
Local LLMsJavaScript★ 134
+134*
stars this week
- 10simplexai-labs/PolyStrata
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith…
LLM toolingC++★ 1.1k
+132
stars this week
Find alternatives to 10 GGUF repos (most-starred first)
Each page lists other tracked repos, mostly from the same category, that share at least two GitHub topics about what they do with it. Browse all alternatives.