inferssd alternatives
wici-ai/inferssd (1.2k stars, +813 this week): Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
Below are 6 other repos tracked by OSS Radar that share GitHub topics with inferssd: 4 from Local LLMs sharing at least two about what they do, and 2 from other categories sharing at least three topics about what they do (platform, language and framework tags don't count), two of them niche rather than broad ones like llm, ordered by how closely their topics overlap (rarer shared topics count more), then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.
1. llama-modchipsynchopate/llama-modchip
+494/wkRun 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB…
1.3k stars · Python · shared topics: apple silicon, GGUF, llama.cpp, mixture of experts · llama-modchip alternatives
2. project-mayamw00/project-maya
+199/wkRun GLM-5.3 (744B), GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one…
2.9k stars · C++ · LLM tooling · shared topics: CUDA, GGUF, LLM, mixture of experts · project-maya alternatives
3. PolyStratasimplexai-labs/PolyStrata
+132/wkRun large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith…
1.1k stars · C++ · LLM tooling · shared topics: CUDA, GGUF, LLM, mixture of experts · PolyStrata alternatives
4. Atomic AgentAtomicBot-ai/atomic-agent
+343/wkAtomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
3.7k stars · TypeScript · shared topics: GGUF, llama.cpp, LLM · Atomic Agent alternatives
5. MACaQhuawei-csl/MACaQ
+314/wkSOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp…
314 stars · C++ · shared topics: GGUF, llama.cpp, LLM · MACaQ alternatives
6. smolmaxxinghyperionaidev/smolmaxxing
+748/wkest.maxxing the ability to run different LLMs on the smallest devices possible.
748 stars · C · shared topics: llama.cpp, LLM · smolmaxxing alternatives
More: all trending Local LLMs repos · trending GGUF repos · trending LLM repos · compare inferssd with the top 2 · alternatives to other trending repos