airllm alternatives

lyogavin/airllm (38k stars, +1.4k this week): AirLLM 2.8T LLM inference with single 4GB GPU. Why it matters: useful plumbing for shipping LLM-powered features.

Below are 12 other LLM tooling repos tracked by OSS Radar that share at least two GitHub topics with airllm, ordered by how many topics overlap, then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.

1. 1. hiyouga/LlamaFactory

   +70/wkest.

   Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024). Why it matters: useful plumbing for shipping LLM-powered features.

   75k stars · Python · shared topics: llama, llm, lora, qlora

2. 2. MakazhanAlpamys/Soup

   +392/wkest.

   Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU. Why it matters: useful plumbing for shipping LLM-powered features.

   8.9k stars · Python · shared topics: llm, lora, qlora

3. 3. langchain-ai/langchain

   +182/wkest.

   The agent engineering platform. Why it matters: useful plumbing for shipping LLM-powered features.

   148k stars · Python · shared topics: generative-ai, llm, open-source

4. 4. langchain-ai/langgraph

   +140/wkest.

   Build resilient agents. Why it matters: useful plumbing for shipping LLM-powered features.

   43k stars · Python · shared topics: generative-ai, llm, open-source

5. 5. rohitg00/ai-engineering-from-scratch

   +1.1k/wkest.

   Learn AI Engineering! Learn it. Build it. Ship it for others. Why it matters: useful plumbing for shipping LLM-powered features.

   69k stars · Python · shared topics: generative-ai, llm

6. 6. Tencent/WeKnora

   +679/wkest.

   Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki. Why it matters: useful plumbing for shipping LLM-powered features.

   34k stars · Go · shared topics: generative-ai, llm

7. 7. BlenderGPT3D/blender-ai-addon

   +581/wkest.

   Blender add-on: create and edit 3D models by chatting with AI - send text or an image, get working bpy code. Why it matters: useful plumbing for shipping LLM-powered features.

   211 stars · Python · shared topics: generative-ai, llm

8. 8. rtk-ai/rtk

   +252/wkest.

   CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies. Why it matters: useful plumbing for shipping LLM-powered features.

   83k stars · Rust · shared topics: llm, open-source

9. 9. ollama/ollama

   +238/wkest.

   Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. Why it matters: useful plumbing for shipping LLM-powered features.

   183k stars · Go · shared topics: llama, llm

10. 10. f/prompts.chat

    +203/wkest.

    f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Why it matters: useful plumbing for shipping LLM-powered features.

    173k stars · HTML · shared topics: llm, open-source

11. 11. unclecode/crawl4ai

    +182/wkest.

    Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Why it matters: useful plumbing for shipping LLM-powered features.

    85k stars · Python · shared topics: llm, open-source

12. 12. trailhq/Trail-Code

    +133/wkest.

    Turbocharge Claude Code, Cursor, Codex, Gemini & every coding agent: faster, cheaper, with contextual understanding specific to your… Why it matters: useful plumbing for shipping LLM-powered features.

    10k stars · TypeScript · shared topics: llm, open-source

More: all trending LLM tooling repos · compare airllm with the top 2