llmfit alternatives

AlexsJones/llmfit (38k stars, +77 this week): Hundreds of models & providers. One command to find what runs on your hardware. Why it matters: useful plumbing for shipping LLM-powered features.

Below are 4 other LLM tooling repos tracked by OSS Radar that share at least two GitHub topics with llmfit, ordered by how many topics overlap, then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.

1. 1. JuliusBrussee/caveman

   +525/wkest.

   🪨 why use many token when few token do trick. Viral skill + proxy for coding agents that cuts 65% of tokens by talking like a caveman. Why it matters: useful plumbing for shipping LLM-powered features.

   112k stars · Go · shared topics: llm, skill

2. 2. MakazhanAlpamys/Soup

   +315/wkest.

   Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU. Why it matters: useful plumbing for shipping LLM-powered features.

   8.9k stars · Python · shared topics: gguf, llm

3. 3. unslothai/unsloth

   +84/wkest.

   Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more. Why it matters: useful plumbing for shipping LLM-powered features.

   78k stars · Python · shared topics: llm, unsloth

4. 4. jundot/omlx

   +56/wkest.

   LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar. Why it matters: useful plumbing for shipping LLM-powered features.

   23k stars · Python · shared topics: llm, mlx

More: all trending LLM tooling repos · compare llmfit with the top 2