ekzhang/resin
Experimental library for building inference engines. Why it matters: useful plumbing for shipping LLM-powered features.
GitHub description: 🧱 Experimental library for building inference engines
Stars
352
Last 24h
+42
Last 7 days
+163est.
Forks
25
Related repos
All resin alternatives →- vllm-project/vllm+650 stars this week
A high-throughput and memory-efficient inference and serving engine for LLMs.
- sgl-project/sglang+534 stars this week
SGLang is a high-performance serving framework for large language models and multimodal models.
- bojieli/ai-infra-book+258 stars this week
Open-source book that derives LLM inference and training system design from hardware limits, with calculation tools.
- mw00/project-maya+555 stars this week
Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own…
Who it's for
- Rust batch scheduler
- Unified slab-based cache pool (KV, SWA, Recurrent)
- Pluggable prefix cache storage
Star history
GitHub stars over time. A steeper line means the repo is gaining attention faster.
Last 2 hours · +4 stars
Daily, since Oct 27, 2026 · 259 → 352
* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.
Discussed on Hacker News
Hacker News is a popular tech discussion site. 1 story links to this repo, with 1 upvotes (points) in total.
Show HN: Resin, fast native scheduler for LLM inference engines1 points · 0 comments · Oct 26, 2026Maintainer? Add the badge to your README
Shows your live OSS Radar rank and links back here. Updates hourly.
[](https://ossradar.net/repo/ekzhang/resin)<a href="https://ossradar.net/repo/ekzhang/resin"><img src="https://ossradar.net/badge/ekzhang/resin" alt="Trending on OSS Radar"></a>About resin
ekzhang/resin is a Python project in the LLM tooling category, created 3 months ago. It has 352 GitHub stars and 25 forks, and gained +163 stars over the last 7 days (early estimate), ranking #164 of 168 LLM tooling repos tracked by OSS Radar this week.
See more trending LLM tooling repos or the top AI repos this week. Looking for something similar? See resin alternatives.
- Language
- Python
- Category
- LLM tooling
- License
- Apache-2.0
- Created
- Aug 8, 2026
- Last code push
- today (Oct 31, 2026)
- Latest release
- No releases yet
Rising in LLM tooling this week
- DietrichGebert/ponytail+6k stars this week
Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.
- Graphify-Labs/graphify+5.5k stars this week
Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph.
- Niko1221/Strata+5k stars this week
Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux.
- thedotmack/claude-mem+4.9k stars this week
Persistent Context Across Sessions for Every Agent – Captures everything your agent does during sessions, compresses it with AI, and injects…
- anhao/ai-pose-gallery-zh+4.6k stars this week
Chinese-translated gallery of AI art pose, outfit and portrait references with a studio for generating AI characters.
- ai-job-search-dev/ai-job-search+3.6k stars this week
The job search that runs on your machine. AI job application framework built on Claude Code: evaluate postings, tailor CVs, write cover…
ekzhang/resin is #221 of 450 on today's leaderboard.