OSS Radar
bojieli/ai-infra-book
《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验. Why it matters: useful plumbing for shipping LLM-powered features.
GitHub description: 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
Stars
6.4k
Last 24h
+123est.
Last 7 days
+864est.
Forks
486
Star history (last 1 snapshot)
Only one snapshot so far. The chart fills in as OSS Radar collects daily snapshots.
est. means the star gain is estimated, not measured: until OSS Radar has collected enough daily snapshots for a repo, we use total stars ÷ days since creation (or extrapolate from the snapshots we do have). Estimates are replaced by measured deltas automatically as history builds up.
Maintainer? Add the badge to your README
Shows your live OSS Radar rank and links back here. Updates hourly.
[](https://ossradar.net/repo/bojieli/ai-infra-book)<a href="https://ossradar.net/repo/bojieli/ai-infra-book"><img src="https://ossradar.net/badge/bojieli/ai-infra-book" alt="Trending on OSS Radar"></a>About ai-infra-book
bojieli/ai-infra-book is a Python project in the LLM tooling category, created 52 days ago. It has 6.4k GitHub stars and 486 forks, and gained +864 stars over the last 7 days (early estimate), ranking #48 of 167 LLM tooling repos tracked by OSS Radar this week.
See more trending LLM tooling repos or the top AI repos this week.
- Language
- Python
- Category
- LLM tooling
- Created
- Aug 22, 2026
- Last push
- Oct 1, 2026
- accelerator
- ai-infra
- ai-infrastructure
- book
- datacenter-network
- deepseek
- distributed-systems
- gpu
- kv-cache
- llm
- llm-inference
- llm-serving
- llm-training
- mixture-of-experts
- performance-engineering
Similar rising repos
- vllm-project/vllm+489est.
A high-throughput and memory-efficient inference and serving engine for LLMs. Why it matters: useful plumbing for shipping LLM-powered features.
- datawhalechina/zero-to-sglang+216est.
Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and… Why it matters: useful plumbing for shipping LLM-powered features.
- FareedKhan-dev/kimi-k3-in-c+864est.
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU. Why it matters: useful plumbing for shipping LLM-powered features.
- unslothai/unsloth+520est.
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more. Why it matters: useful plumbing for shipping LLM-powered features.
- hiyouga/LlamaFactory+428est.
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024). Why it matters: useful plumbing for shipping LLM-powered features.
- huggingface/transformers+404est.
Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both… Why it matters: useful plumbing for shipping LLM-powered features.