OSS Radar

MACaQ alternatives

huawei-csl/MACaQ (314 stars, +314 this week): SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp…

Below are 6 other Local LLMs repos tracked by OSS Radar that share at least two GitHub topics about what they do with MACaQ (platform, language and framework tags don't count), ordered by how closely their topics overlap (rarer shared topics count more), then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.

  1. 1. llama-modchipsynchopate/llama-modchip

    +494/wk

    Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB…

    1.3k stars · Python · shared topics: GGUF, llama.cpp, quantization · llama-modchip alternatives

  2. 2. smolmaxxinghyperionaidev/smolmaxxing

    +748/wkest.

    maxxing the ability to run different LLMs on the smallest devices possible.

    748 stars · C · shared topics: llama.cpp, LLM, quantization · smolmaxxing alternatives

  3. 3. inferssdwici-ai/inferssd

    +813/wk

    Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    1.2k stars · C++ · shared topics: GGUF, llama.cpp, LLM · inferssd alternatives

  4. 4. Atomic AgentAtomicBot-ai/atomic-agent

    +343/wk

    Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

    3.7k stars · TypeScript · shared topics: GGUF, llama.cpp, LLM · Atomic Agent alternatives

  5. 5. yogurtFrigadeHQ/yogurt

    +1.7k/wk

    Private AI meeting notes that stay on your computer. A free, open-source alternative to Granola for Mac, Windows and Linux.

    1.7k stars · TypeScript · shared topics: llama.cpp, local AI · yogurt alternatives

  6. 6. MeetilyZackriya-Solutions/meetily

    +153/wk

    Privacy-first AI meeting note taker for Windows, macOS and Linux. Free, open source (MIT).

    33k stars · Rust · shared topics: LLM, local AI · Meetily alternatives

More: all trending Local LLMs repos · trending GGUF repos · trending LLM repos · trending video generation repos · compare MACaQ with the top 2 · alternatives to other trending repos