omlx alternatives

jundot/omlx (23k stars, +70 this week): LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar. Why it matters: useful plumbing for shipping LLM-powered features.

Below are 5 other LLM tooling repos tracked by OSS Radar that share at least two GitHub topics with omlx, ordered by how many topics overlap, then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.

1. 1. mw00/project-maya

   +732/wkest.

   Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Why it matters: useful plumbing for shipping LLM-powered features.

   767 stars · C++ · shared topics: llm, openai-api

2. 2. AlexsJones/llmfit

   +98/wkest.

   Hundreds of models & providers. One command to find what runs on your hardware. Why it matters: useful plumbing for shipping LLM-powered features.

   38k stars · Rust · shared topics: llm, mlx

3. 3. Folkbench/folkbench

   +91/wkest.

   Desktop app that switches Claude Code, Codex and other tools between AI API relays, showing their uptime and latency. Why it matters: useful plumbing for shipping LLM-powered features.

   854 stars · Rust · shared topics: llm, openai-api

4. 4. Bingeljell/image-to-3dlab

   +70/wkest.

   AssetFurnace: the most complete open-source image-to-3D pipeline (Oct 2026). Why it matters: useful plumbing for shipping LLM-powered features.

   750 stars · Python · shared topics: apple-silicon, mlx

5. 5. qunqin24/Pulse

   +56/wkest.

   Know how much Claude Code, Codex, Cursor, Copilot and 70+ other AI coding tools you have left — a free, open-source macOS monitor on the… Why it matters: useful plumbing for shipping LLM-powered features.

   546 stars · Swift · shared topics: llm, macos

More: all trending LLM tooling repos · compare omlx with the top 2