datawhalechina/zero-to-sglang
Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and… Why it matters: useful plumbing for shipping LLM-powered features.
GitHub description: Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.
Stars
1.5k
Last 24h
+31est.
Last 7 days
+216est.
Forks
113
Star history (last 1 snapshot)
Only one snapshot so far. The chart fills in as OSS Radar collects daily snapshots.
* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.
Maintainer? Add the badge to your README
Shows your live OSS Radar rank and links back here. Updates hourly.
[](https://ossradar.net/repo/datawhalechina/zero-to-sglang)<a href="https://ossradar.net/repo/datawhalechina/zero-to-sglang"><img src="https://ossradar.net/badge/datawhalechina/zero-to-sglang" alt="Trending on OSS Radar"></a>About zero-to-sglang
datawhalechina/zero-to-sglang is a Python project in the LLM tooling category, created 47 days ago. It has 1.5k GitHub stars and 113 forks, and gained +216 stars over the last 7 days (early estimate), ranking #161 of 167 LLM tooling repos tracked by OSS Radar this week.
See more trending LLM tooling repos or the top AI repos this week.
- Language
- Python
- Category
- LLM tooling
- Created
- Aug 27, 2026
- Last push
- Oct 13, 2026
- cuda
- datawhale
- inference-engine
- infra
- kv-cache
- llm
- llm-inference
- sglang
- tutorial
Similar rising repos
- bojieli/ai-infra-book+864est.
《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验. Why it matters: useful plumbing for shipping LLM-powered features.
- syv-ai/HyperQwen+234est.
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer… Why it matters: useful plumbing for shipping LLM-powered features.
- FareedKhan-dev/kimi-k3-in-c+863est.
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU. Why it matters: useful plumbing for shipping LLM-powered features.
- rohitg00/ai-engineering-from-scratch+2.3kest.
Learn AI Engineering! Learn it. Build it. Ship it for others. Why it matters: useful plumbing for shipping LLM-powered features.
- vllm-project/vllm+489est.
A high-throughput and memory-efficient inference and serving engine for LLMs. Why it matters: useful plumbing for shipping LLM-powered features.
- sgl-project/sglang+257est.
SGLang is a high-performance serving framework for large language models and multimodal models. Why it matters: useful plumbing for shipping LLM-powered features.