# trnrt (RunanywhereAI/trnrt)

> The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.

Data from OSS Radar as of 2026-11-09T19:13:48.951Z (UTC), updated hourly. HTML page: https://ossradar.net/repo/RunanywhereAI/trnrt

## Star velocity

- Stars: 258 (258)
- Gained in the last 24 hours: +26 (estimated: first seen less than a week ago)
- Gained in the last 7 days: +180 (estimated: first seen less than a week ago)
- Rank today: #381 of 450 tracked repos
- Rank this week: #415 of 450 tracked repos
- Forks: 5

## Facts

- GitHub: https://github.com/RunanywhereAI/trnrt
- Homepage: https://runanywhere.ai/blog/glm-5-3-flash-trainium2-nki-megakernels
- Category: [LLM tooling](https://ossradar.net/category/llm-tooling)
- Language: Python
- License: Apache-2.0
- Topics: aws, glm, inference, llm, llm-serving, megakernels, neuron, nki, openai-api, trainium
- Created: 2026-10-30; last push: 2026-11-09

## Alternatives

- [vLLM](https://ossradar.net/repo/vllm-project/vllm): +450 stars this week
- [project-maya](https://ossradar.net/repo/mw00/project-maya): +303 stars this week
- [SGLang](https://ossradar.net/repo/sgl-project/sglang): +235 stars this week
- [PolyStrata](https://ossradar.net/repo/simplexai-labs/PolyStrata): +166 stars this week
- [ai-infra-book](https://ossradar.net/repo/bojieli/ai-infra-book): +180 stars this week

More: https://ossradar.net/alternatives/RunanywhereAI/trnrt

## More

- JSON: https://ossradar.net/api/v1/repo/RunanywhereAI/trnrt
- README badge: https://ossradar.net/badge/RunanywhereAI/trnrt
- Full leaderboard: https://ossradar.net/ (also https://ossradar.net/llms.txt)

Free to cite with a link back to https://ossradar.net/repo/RunanywhereAI/trnrt.