OSS Radar
Back

Topic

Trending GGUF GitHub repos

Repos whose maintainers tagged them gguf on GitHub (topics are labels that describe what a project is about), ranked by stars gained.

10 repos gained about 4.2k stars in the last 7 days. Leading this week: BLA (+1.5k stars), inferssd (+813) and llama-modchip (+494).

By category: Local LLMs (5), LLM tooling (4) and MCP (1).

10 repos tracked · ranked by stars gained · updated hourly

Related topics:LLMlocal LLMAI agentsClaude CodeMCPself-hostedDeepSeekCLIWindowsOllama

GGUF leaderboard

* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.

  1. 1
    qybaihe/bla

    BLA (bla-agents / Blind LLM Agents) — Open-source Blue Defense MCP server & CLI protecting JS/TS, Electron ASAR, WASM, Python, Native…

    MCPTypeScript★ 5.8k

    +1.5k

    stars this week

  2. 2
    wici-ai/inferssd

    Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    Local LLMsC++★ 1.2k

    +813

    stars this week

  3. 3
    synchopate/llama-modchip

    Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB…

    Local LLMsPython★ 1.3k

    +494

    stars this week

  4. 4
    AtomicBot-ai/atomic-agent

    Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

    Local LLMsTypeScript★ 3.7k

    +343

    stars this week

  5. 5
    huawei-csl/MACaQ

    SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp…

    Local LLMsC++★ 314

    +314

    stars this week

  6. 6
    mw00/project-maya

    Run GLM-5.3 (744B), GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one…

    LLM toolingC++★ 2.9k

    +199

    stars this week

  7. 7
    MakazhanAlpamys/Soup

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

    LLM toolingPython★ 11k

    +184

    stars this week

  8. 8
    AlexsJones/llmfit

    Hundreds of models & providers. One command to find what runs on your hardware.

    LLM toolingRust★ 39k

    +145

    stars this week

  9. 9
    CapriChooms/CapriCore

    Capri — an AI desktop companion for Windows with local/API models, Hugging Face, optional voice, memory and permission-based desktop tools.

    Local LLMsJavaScript★ 134

    +134*

    stars this week

  10. 10
    simplexai-labs/PolyStrata

    Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith…

    LLM toolingC++★ 1.1k

    +132

    stars this week

Find alternatives to 10 GGUF repos (most-starred first)

Each page lists other tracked repos, mostly from the same category, that share at least two GitHub topics about what they do with it. Browse all alternatives.