LlamaFactory alternatives

hiyouga/LlamaFactory (75k stars, +49 this week): Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024). Why it matters: useful plumbing for shipping LLM-powered features.

Below are 12 other LLM tooling repos tracked by OSS Radar that share at least two GitHub topics with LlamaFactory, ordered by how many topics overlap, then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.

1. 1. unslothai/unsloth

   +84/wkest.

   Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more. Why it matters: useful plumbing for shipping LLM-powered features.

   78k stars · Python · shared topics: agent, ai, deepseek, fine-tuning, gemma, llama, llm, qwen

2. 2. MakazhanAlpamys/Soup

   +315/wkest.

   Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU. Why it matters: useful plumbing for shipping LLM-powered features.

   8.9k stars · Python · shared topics: fine-tuning, llm, lora, peft, qlora, transformers

3. 3. ollama/ollama

   +168/wkest.

   Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. Why it matters: useful plumbing for shipping LLM-powered features.

   183k stars · Go · shared topics: deepseek, gemma, llama, llama3, llm, qwen

4. 4. vllm-project/vllm

   +56/wkest.

   A high-throughput and memory-efficient inference and serving engine for LLMs. Why it matters: useful plumbing for shipping LLM-powered features.

   94k stars · Python · shared topics: deepseek, gpt, llama, llm, moe, qwen

5. 5. langgenius/dify

   +126/wkest.

   Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Why it matters: useful plumbing for shipping LLM-powered features.

   158k stars · TypeScript · shared topics: agent, ai, deepseek, gpt, llm

6. 6. AstrBotDevs/AstrBot

   +98/wkest.

   AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw… Why it matters: useful plumbing for shipping LLM-powered features.

   42k stars · Python · shared topics: agent, ai, gpt, llama, llm

7. 7. sgl-project/sglang

   +77/wkest.

   SGLang is a high-performance serving framework for large language models and multimodal models. Why it matters: useful plumbing for shipping LLM-powered features.

   37k stars · Python · shared topics: deepseek, llama, llm, moe, qwen

8. 8. huggingface/transformers

   +70/wkest.

   🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models… Why it matters: useful plumbing for shipping LLM-powered features.

   168k stars · Python · shared topics: deepseek, gemma, llm, nlp, qwen

9. 9. lyogavin/airllm

   +1.1k/wkest.

   AirLLM 2.8T LLM inference with single 4GB GPU. Why it matters: useful plumbing for shipping LLM-powered features.

   38k stars · Jupyter Notebook · shared topics: llama, llm, lora, qlora

10. 10. rohitg00/ai-engineering-from-scratch

    +889/wkest.

    Learn AI Engineering! Learn it. Build it. Ship it for others. Why it matters: useful plumbing for shipping LLM-powered features.

    69k stars · Python · shared topics: ai, llm, nlp, transformers

11. 11. lobehub/lobehub

    +56/wkest.

    🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI… Why it matters: useful plumbing for shipping LLM-powered features.

    83k stars · TypeScript · shared topics: agent, ai, deepseek, gpt

12. 12. amitshekhariitbhu/ai-engineering-interview-questions

    +42/wkest.

    Your Cheat Sheet for AI Engineering Interview – Questions and Answers. Why it matters: useful plumbing for shipping LLM-powered features.

    3.4k stars · Markdown · shared topics: ai, fine-tuning, llm, quantization

More: all trending LLM tooling repos · compare LlamaFactory with the top 2