LocalAI alternatives

mudler/LocalAI (50k stars, +35 this week): LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. Why it matters: useful plumbing for shipping LLM-powered features.

Below are 12 other LLM tooling repos tracked by OSS Radar that share at least two GitHub topics with LocalAI, ordered by how many topics overlap, then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.

1. 1. unslothai/unsloth

   +84/wkest.

   Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more. Why it matters: useful plumbing for shipping LLM-powered features.

   78k stars · Python · shared topics: ai, image-generation, llama, llm, stable-diffusion, tts

2. 2. mastra-ai/mastra

   +49/wkest.

   Mastra is the modern TypeScript framework for AI-powered applications and agents. Why it matters: useful plumbing for shipping LLM-powered features.

   29k stars · TypeScript · shared topics: agents, ai, llm, mcp, tts

3. 3. rohitg00/ai-engineering-from-scratch

   +889/wkest.

   Learn AI Engineering! Learn it. Build it. Ship it for others. Why it matters: useful plumbing for shipping LLM-powered features.

   69k stars · Python · shared topics: agents, ai, llm, mcp

4. 4. AstrBotDevs/AstrBot

   +98/wkest.

   AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw… Why it matters: useful plumbing for shipping LLM-powered features.

   42k stars · Python · shared topics: ai, llama, llm, mcp

5. 5. amitshekhariitbhu/ai-engineering-interview-questions

   +42/wkest.

   Your Cheat Sheet for AI Engineering Interview – Questions and Answers. Why it matters: useful plumbing for shipping LLM-powered features.

   3.4k stars · Markdown · shared topics: agents, ai, llm, mcp

6. 6. KKKKhazix/AIHOT

   +371/wkest.

   A website framework that collects hot topics from your sources and writes daily reports for any industry. Why it matters: useful plumbing for shipping LLM-powered features.

   7.6k stars · TypeScript · shared topics: ai, llm, mcp

7. 7. headroomlabs-ai/headroom

   +266/wkest.

   Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. Why it matters: useful plumbing for shipping LLM-powered features.

   75k stars · Python · shared topics: ai, llm, mcp

8. 8. open-webui/open-webui

   +175/wkest.

   User-friendly AI Interface (Supports Ollama, OpenAI API, ...). Why it matters: useful plumbing for shipping LLM-powered features.

   156k stars · Python · shared topics: ai, llm, mcp

9. 9. langchain-ai/langchain

   +161/wkest.

   The agent engineering platform. Why it matters: useful plumbing for shipping LLM-powered features.

   148k stars · Python · shared topics: agents, ai, llm

10. 10. unclecode/crawl4ai

    +140/wkest.

    Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Why it matters: useful plumbing for shipping LLM-powered features.

    85k stars · Python · shared topics: ai, llm, mcp

11. 11. langgenius/dify

    +126/wkest.

    Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Why it matters: useful plumbing for shipping LLM-powered features.

    158k stars · TypeScript · shared topics: ai, llm, mcp

12. 12. langchain-ai/langgraph

    +119/wkest.

    Build resilient agents. Why it matters: useful plumbing for shipping LLM-powered features.

    43k stars · Python · shared topics: agents, ai, llm

More: all trending LLM tooling repos · compare LocalAI with the top 2