llm-architecture-from-scratch alternatives

YeonwooSung/llm-architecture-from-scratch (610 stars, +644 this week): Implementing LLM architectures from scratch in PyTorch. Why it matters: useful plumbing for shipping LLM-powered features.

Below are 5 other LLM tooling repos tracked by OSS Radar that share at least two GitHub topics with llm-architecture-from-scratch, ordered by how many topics overlap, then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.

1. 1. vllm-project/vllm

   +70/wkest.

   A high-throughput and memory-efficient inference and serving engine for LLMs. Why it matters: useful plumbing for shipping LLM-powered features.

   94k stars · Python · shared topics: llm, moe, qwen3

2. 2. mw00/project-maya

   +732/wkest.

   Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Why it matters: useful plumbing for shipping LLM-powered features.

   767 stars · C++ · shared topics: llm, moe

3. 3. ollama/ollama

   +238/wkest.

   Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. Why it matters: useful plumbing for shipping LLM-powered features.

   183k stars · Go · shared topics: gemma3, llm

4. 4. sgl-project/sglang

   +98/wkest.

   SGLang is a high-performance serving framework for large language models and multimodal models. Why it matters: useful plumbing for shipping LLM-powered features.

   37k stars · Python · shared topics: llm, moe

5. 5. hiyouga/LlamaFactory

   +70/wkest.

   Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024). Why it matters: useful plumbing for shipping LLM-powered features.

   75k stars · Python · shared topics: llm, moe

More: all trending LLM tooling repos · compare llm-architecture-from-scratch with the top 2