huawei-csl/MACaQ
SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp… Why it matters: helps you run models on your own hardware without an API bill.
GitHub description: SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch.
Stars
314
Last 24h
+3
Last 7 days
+314
Forks
21
Related repos
All MACaQ alternatives →- llama-modchipsynchopate/llama-modchip+494 stars this week
Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB…
- smolmaxxinghyperionaidev/smolmaxxing+748est. stars this week
maxxing the ability to run different LLMs on the smallest devices possible.
- inferssdwici-ai/inferssd+813 stars this week
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
- Atomic AgentAtomicBot-ai/atomic-agent+343 stars this week
Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
Star history
GitHub stars over time. A steeper line means the repo is gaining attention faster.
Last 4 hours · +17 stars
Daily, since Nov 15, 2026 · 311 → 314
Discussed on Hacker News
Hacker News is a popular tech discussion site. 1 story links to this repo, with 134 upvotes (points) in total.
Huawei releases MACaQ, its internal quantizer for local inference134 points · 32 comments · Nov 11, 2026Maintainer? Add the badge to your README
Shows your live OSS Radar rank and links back here. Updates hourly. How the badge works.
[](https://ossradar.net/repo/huawei-csl/MACaQ)<a href="https://ossradar.net/repo/huawei-csl/MACaQ"><img src="https://ossradar.net/badge/huawei-csl/MACaQ" alt="Trending on OSS Radar"></a>About MACaQ
huawei-csl/MACaQ is a C++ project in the Local LLMs category, created 6 days ago. It has 314 GitHub stars and 21 forks, and gained +314 stars over the last 7 days, ranking #7 of 10 Local LLMs repos tracked by OSS Radar this week.
See more trending Local LLMs repos or the top AI repos this week. Looking for something similar? See MACaQ alternatives.
- Language
- C++
- Category
- Local LLMs
- License
- Apache-2.0
- Created
- Nov 10, 2026
- Last code push
- 3 days ago (Nov 12, 2026)
- Latest release
- No releases yet
- ascend
- audio
- audio generation
- diffusers
- GGUF
- GGUF quantization
- image generation
- llama.cpp
- LLM
- local AI
- local inference
- quantization
- video generation
- vllm
Rising in Local LLMs this week
- yogurtFrigadeHQ/yogurt+1.7k stars this week
Private AI meeting notes that stay on your computer. A free, open-source alternative to Granola for Mac, Windows and Linux.
- Ollamaollama/ollama+675 stars this week
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
- MeetilyZackriya-Solutions/meetily+153 stars this week
Privacy-first AI meeting note taker for Windows, macOS and Linux. Free, open source (MIT).
- CapriCoreCapriChooms/CapriCore+134est. stars this week
Capri — an AI desktop companion for Windows with local/API models, Hugging Face, optional voice, memory and permission-based desktop tools.
- sakuttojammaru/sakutto+132 stars this week
A browser extension for easy on-device translation with a local LLM (PLaMo). Private, free, no server needed.
MACaQ is #406 of 450 on today's leaderboard.