smolmaxxing alternatives
hyperionaidev/smolmaxxing (748 stars, +748 this week): maxxing the ability to run different LLMs on the smallest devices possible.
Below are 5 other Local LLMs repos tracked by OSS Radar that share at least two GitHub topics about what they do with smolmaxxing (platform, language and framework tags don't count), ordered by how closely their topics overlap (rarer shared topics count more), then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.
1. llama-modchipsynchopate/llama-modchip
+494/wkRun 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB…
1.3k stars · Python · shared topics: llama.cpp, local LLM, quantization · llama-modchip alternatives
2. MACaQhuawei-csl/MACaQ
+314/wkSOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp…
314 stars · C++ · shared topics: llama.cpp, LLM, quantization · MACaQ alternatives
3. Atomic AgentAtomicBot-ai/atomic-agent
+343/wkAtomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
3.7k stars · TypeScript · shared topics: llama.cpp, LLM, local LLM · Atomic Agent alternatives
4. sakuttojammaru/sakutto
+132/wkA browser extension for easy on-device translation with a local LLM (PLaMo). Private, free, no server needed.
253 stars · TypeScript · shared topics: llama.cpp, local LLM · sakutto alternatives
5. inferssdwici-ai/inferssd
+813/wkRun models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
1.2k stars · C++ · shared topics: llama.cpp, LLM · inferssd alternatives
More rising Local LLMs repos
Only 5 tracked repos share at least two GitHub topics with smolmaxxing, so here are the Local LLMs repos gaining the most stars this week. They sit in the same category but don't share its topics, so treat them as related projects rather than alternatives.
- yogurt +1.7k/wk: Private AI meeting notes that stay on your computer. A free, open-source alternative to Granola for Mac, Windows and Linux.
- Ollama +675/wk: Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
- Meetily +153/wk: Privacy-first AI meeting note taker for Windows, macOS and Linux. Free, open source (MIT).
- CapriCore +134/wk: Capri — an AI desktop companion for Windows with local/API models, Hugging Face, optional voice, memory and permission-based desktop tools.
More: all trending Local LLMs repos · trending LLM repos · trending local LLM repos · compare smolmaxxing with the top 2 · alternatives to other trending repos