OmniJev/Flide
The extremely fast inference engine for decision model. Why it matters: useful plumbing for shipping LLM-powered features.
GitHub description: 🔥🔥 The extremely fast inference engine for decision model
Stars
511
Last 24h
+6
Last 7 days
+240
Forks
34
Related repos
All Flide alternatives →- zero-to-sglangdatawhalechina/zero-to-sglang+399 stars this week
Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang…
- PolyStratasimplexai-labs/PolyStrata+132 stars this week
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith…
- vLLMvllm-project/vllm+361 stars this week
A high-throughput and memory-efficient inference and serving engine for LLMs.
- ai-infra-bookbojieli/ai-infra-book+407 stars this week
Open-source book that derives LLM inference and training system design from hardware limits, with calculation tools.
Star history
GitHub stars over time. A steeper line means the repo is gaining attention faster.
Last 48 hours · +171 stars
Daily, since Nov 9, 2026 · 271 → 511
Discussed on Hacker News
Hacker News is a popular tech discussion site. 1 story links to this repo, with 124 upvotes (points) in total.
Show HN: Flide: Make Jev-like decision models up to 9.5x faster124 points · 30 comments · Nov 9, 2026Maintainer? Add the badge to your README
Shows your live OSS Radar rank and links back here. Updates hourly. How the badge works.
[](https://ossradar.net/repo/OmniJev/Flide)<a href="https://ossradar.net/repo/OmniJev/Flide"><img src="https://ossradar.net/badge/OmniJev/Flide" alt="Trending on OSS Radar"></a>About Flide
OmniJev/Flide is a Python project in the LLM tooling category, created 23 days ago. It has 511 GitHub stars and 34 forks, and gained +240 stars over the last 7 days, ranking #80 of 135 LLM tooling repos tracked by OSS Radar this week.
See more trending LLM tooling repos or the top AI repos this week. Looking for something similar? See Flide alternatives.
- Language
- Python
- Category
- LLM tooling
- License
- Apache-2.0
- Created
- Oct 24, 2026
- Last code push
- 3 days ago (Nov 12, 2026)
- Latest release
- v0.1.15 3 days ago
- AI agents
- CUDA
- decision making
- deterministic inference
- Gemma
- inference engine
- jev
- kv cache
- large language models
- linear attention
- LLM
- LLM agents
- LLM as a judge
- LLM inference
- LLM serving
- multimodal
- prefix caching
- PyTorch
- Qwen
- triton
Rising in LLM tooling this week
- unslopheydamir/unslop+4.1k stars this week
A Claude skill that turns vibecoded, AI-looking UI into a designed interface.
- rea-videoJuneYaooo/rea-video+3.8k stars this week
Reverse-engineer any video, shot by shot: filmed, AI-generated or coded, and how to remake it. Breakdowns in the open VIDEO.md format.
- daily_stock_analysisZhuLinsen/daily_stock_analysis+3.7k stars this week
LLM-powered multi-market stock analysis system with multi-source market data, real-time news, decision dashboard, automated notifications…
- Claude-CageLee-xeo/Claude-Cage+3.7kest. stars this week
Lightweight virtual machine for using Claude with isolated network and fingerprint settings, multi-account support and remote control.
- GraphifyGraphify-Labs/graphify+3.5k stars this week
Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph.
- lemo-opuscarlemomo-ai/lemo-opuscar+2.7k stars this week
A toolbox of film styles made in code for Claude Code: 99 ready to use, and your own.
Flide is #391 of 450 on today's leaderboard.