# 6 open-source alternatives to inferssd

[inferssd](https://ossradar.net/repo/wici-ai/inferssd) (wici-ai/inferssd) has 1.2k stars and gained +813 in the last 7 days. Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

Below are other repos tracked by OSS Radar that share GitHub topics about what they do with inferssd (platform, language and framework tags don't count), ordered by how closely their topics overlap (rarer shared topics count more), then by stars gained this week. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README. Data as of 2026-11-16T02:48:20.780Z (UTC), updated hourly. HTML page: https://ossradar.net/alternatives/wici-ai/inferssd

## Alternatives

| # | Repo | Category | 7 days | Total stars | Shared topics | What it is |
| --- | --- | --- | --- | --- | --- | --- |
| 1 | [llama-modchip](https://ossradar.net/repo/synchopate/llama-modchip) (synchopate/llama-modchip) | Local LLMs | +494 | 1271 | apple silicon, GGUF, llama.cpp, mixture of experts | Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB… |
| 2 | [project-maya](https://ossradar.net/repo/mw00/project-maya) (mw00/project-maya) | LLM tooling | +199 | 2936 | CUDA, GGUF, LLM, mixture of experts | Run GLM-5.3 (744B), GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one… |
| 3 | [PolyStrata](https://ossradar.net/repo/simplexai-labs/PolyStrata) (simplexai-labs/PolyStrata) | LLM tooling | +132 | 1085 | CUDA, GGUF, LLM, mixture of experts | Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith… |
| 4 | [Atomic Agent](https://ossradar.net/repo/AtomicBot-ai/atomic-agent) (AtomicBot-ai/atomic-agent) | Local LLMs | +343 | 3686 | GGUF, llama.cpp, LLM | Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp. |
| 5 | [MACaQ](https://ossradar.net/repo/huawei-csl/MACaQ) (huawei-csl/MACaQ) | Local LLMs | +314 | 314 | GGUF, llama.cpp, LLM | SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp… |
| 6 | [smolmaxxing](https://ossradar.net/repo/hyperionaidev/smolmaxxing) (hyperionaidev/smolmaxxing) | Local LLMs | +748 est. | 748 | llama.cpp, LLM | maxxing the ability to run different LLMs on the smallest devices possible. |

Gains marked est. are estimates for repos first seen less than a week ago. Each repo also has a Markdown page: append .md to its repo URL.

## More

- inferssd repo page: https://ossradar.net/repo/wici-ai/inferssd (Markdown: https://ossradar.net/repo/wici-ai/inferssd.md)
- Alternatives to llama-modchip: https://ossradar.net/alternatives/synchopate/llama-modchip.md
- Alternatives to project-maya: https://ossradar.net/alternatives/mw00/project-maya.md
- Alternatives to PolyStrata: https://ossradar.net/alternatives/simplexai-labs/PolyStrata.md
- Alternatives to Atomic Agent: https://ossradar.net/alternatives/AtomicBot-ai/atomic-agent.md
- Alternatives to MACaQ: https://ossradar.net/alternatives/huawei-csl/MACaQ.md
- Alternatives to smolmaxxing: https://ossradar.net/alternatives/hyperionaidev/smolmaxxing.md
- All trending Local LLMs repos: https://ossradar.net/category/local-llms.md
- Alternatives to other trending repos: https://ossradar.net/alternatives
- Live leaderboard: https://ossradar.net/ (also https://ossradar.net/llms.txt and https://ossradar.net/api/v1/trending)

Free to cite with a link back to https://ossradar.net/alternatives/wici-ai/inferssd.
