OSS Radar
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs. Why it matters: useful plumbing for shipping LLM-powered features.
GitHub description: A high-throughput and memory-efficient inference and serving engine for LLMs
Stars
94k
Last 24h
+70est.
Last 7 days
+489est.
Forks
23k
Star history (last 1 snapshot)
Only one snapshot so far. The chart fills in as OSS Radar collects daily snapshots.
* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.
Maintainer? Add the badge to your README
Shows your live OSS Radar rank and links back here. Updates hourly.
[](https://ossradar.net/repo/vllm-project/vllm)<a href="https://ossradar.net/repo/vllm-project/vllm"><img src="https://ossradar.net/badge/vllm-project/vllm" alt="Trending on OSS Radar"></a>About vllm
vllm-project/vllm is a Python project in the LLM tooling category, created 4 years ago. It has 94k GitHub stars and 23k forks, and gained +489 stars over the last 7 days (early estimate), ranking #85 of 167 LLM tooling repos tracked by OSS Radar this week.
See more trending LLM tooling repos or the top AI repos this week.
- Language
- Python
- Category
- LLM tooling
- Created
- Feb 9, 2023
- Last push
- Oct 13, 2026
- amd
- blackwell
- cuda
- deepseek
- deepseek-v3
- gpt
- gpt-oss
- inference
- kimi
- llama
- llm
- llm-serving
- model-serving
- moe
- openai
- pytorch
- qwen
- qwen3
- tpu
- transformer
Similar rising repos
- sgl-project/sglang+257est.
SGLang is a high-performance serving framework for large language models and multimodal models. Why it matters: useful plumbing for shipping LLM-powered features.
- hiyouga/LlamaFactory+428est.
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024). Why it matters: useful plumbing for shipping LLM-powered features.
- unslothai/unsloth+520est.
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more. Why it matters: useful plumbing for shipping LLM-powered features.
- huggingface/transformers+404est.
Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both… Why it matters: useful plumbing for shipping LLM-powered features.
- ollama/ollama+1.1kest.
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. Why it matters: useful plumbing for shipping LLM-powered features.
- yamadashy/repomix+245est.
Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to… Why it matters: useful plumbing for shipping LLM-powered features.