OSS Radar
RunanywhereAI/trnrt
The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere. Why it matters: useful plumbing for shipping LLM-powered features.
GitHub description: The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.
Stars
258
Last 24h
+26est.
Last 7 days
+180est.
Forks
5
Related repos
All trnrt alternatives →- vLLMvllm-project/vllm+450 stars this week
A high-throughput and memory-efficient inference and serving engine for LLMs.
- project-mayamw00/project-maya+303 stars this week
Run GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard…
- SGLangsgl-project/sglang+235 stars this week
SGLang is a high-performance serving framework for large language models and multimodal models.
- PolyStratasimplexai-labs/PolyStrata+166est. stars this week
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith…
Star history
GitHub stars over time. A steeper line means the repo is gaining attention faster.
Not enough history yet. OSS Radar records stars every hour, so this chart fills in over the next few hours.
* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.
Maintainer? Add the badge to your README
Shows your live OSS Radar rank and links back here. Updates hourly.
[](https://ossradar.net/repo/RunanywhereAI/trnrt)<a href="https://ossradar.net/repo/RunanywhereAI/trnrt"><img src="https://ossradar.net/badge/RunanywhereAI/trnrt" alt="Trending on OSS Radar"></a>About trnrt
RunanywhereAI/trnrt is a Python project in the LLM tooling category, created 10 days ago. It has 258 GitHub stars and 5 forks, and gained +180 stars over the last 7 days (early estimate), ranking #129 of 139 LLM tooling repos tracked by OSS Radar this week.
See more trending LLM tooling repos or the top AI repos this week. Looking for something similar? See trnrt alternatives.
- Language
- Python
- Category
- LLM tooling
- License
- Apache-2.0
- Created
- Oct 30, 2026
- Last code push
- today (Nov 9, 2026)
- Latest release
- v0.1.0 today
- aws
- GLM
- inference
- LLM
- LLM serving
- megakernels
- neuron
- nki
- OpenAI API
- trainium
Rising in LLM tooling this week
- unslopheydamir/unslop+6.4k stars this week
A Claude skill that turns vibecoded, AI-looking UI into a designed interface.
- rea-videoJuneYaooo/rea-video+5.4kest. stars this week
Reverse-engineer any video, shot by shot: filmed, AI-generated or coded, and how to remake it.
- Claude-Memthedotmack/claude-mem+4.6k stars this week
Persistent Context Across Sessions for Every Agent – Captures everything your agent does during sessions, compresses it with AI, and injects…
- MoneyPrinterTurboharry0703/MoneyPrinterTurbo+4k stars this week
Generate HD short videos from a topic or keyword with an automated AI workflow.
- StrataNiko1221/Strata+4k stars this week
Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux.
- GraphifyGraphify-Labs/graphify+3.8k stars this week
Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph.
trnrt is #381 of 450 on today's leaderboard.