OSS Radar
mlc-ai/mlc-llm
Universal LLM Deployment Engine with ML Compilation. Why it matters: useful plumbing for shipping LLM-powered features.
GitHub description: Universal LLM Deployment Engine with ML Compilation
Stars
23k
Last 24h
+18est.
Last 7 days
+128est.
Forks
2.2k
Related repos
- vercel/ai+124 stars this week
The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications…
- Graphify-Labs/graphify+6.3k stars this week
Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph.
- rohitg00/ai-engineering-from-scratch+2.5k stars this week
Learn AI Engineering! Learn it. Build it. Ship it for others.
- harry0703/MoneyPrinterTurbo+2.2k stars this week
Generate HD short videos from a topic or keyword with an automated AI workflow.
Star history
GitHub stars over time. A steeper line means the repo is gaining attention faster.
Last 2 hours · +0 stars
* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.
Discussed on Hacker News
Hacker News is a popular tech discussion site. 3 stories link to this repo, with 308 upvotes (points) in total.
MLC-LLM: GPT/Llama on consumer-class GPUs and phones303 points · 106 comments · Apr 30, 2023See all 3 on HN search →Maintainer? Add the badge to your README
Shows your live OSS Radar rank and links back here. Updates hourly.
[](https://ossradar.net/repo/mlc-ai/mlc-llm)<a href="https://ossradar.net/repo/mlc-ai/mlc-llm"><img src="https://ossradar.net/badge/mlc-ai/mlc-llm" alt="Trending on OSS Radar"></a>About mlc-llm
mlc-ai/mlc-llm is a Python project in the LLM tooling category, created 3 years ago. It has 23k GitHub stars and 2.2k forks, and gained +128 stars over the last 7 days (early estimate), ranking #169 of 171 LLM tooling repos tracked by OSS Radar this week.
See more trending LLM tooling repos or the top AI repos this week.
- Language
- Python
- Category
- LLM tooling
- Created
- Apr 29, 2023
- Last code push
- today (Oct 25, 2026)
- Latest release
- No releases yet
- language model
- LLM
- machine learning compilation
- tvm
Rising in LLM tooling this week
- Ebony-Vinyl/dsh-our-free-model+17k stars this week
All you do is install this plugin in dsh: no login, no sign-up, no API key — the frontier models are just there, DeepSeek V4.1 Flash and…
- affaan-m/ECC+5.1k stars this week
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code…
- Niko1221/Strata+4.9k stars this week
Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux.
- ai-job-search-dev/ai-job-search+4.1kest. stars this week
The job search that runs on your machine. AI job application framework built on Claude Code: evaluate postings, tailor CVs, write cover…
- lemomo-ai/lemo-opuscar+3.9k stars this week
A toolbox of film styles made in code for Claude Code: 59 ready to use, and your own.
- cheaper-inference/OmniRoute+2.6kest. stars this week
Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek…
mlc-ai/mlc-llm is #356 of 450 on today's leaderboard.