# 8 open-source alternatives to trnrt

[trnrt](https://ossradar.net/repo/RunanywhereAI/trnrt) (RunanywhereAI/trnrt) has 258 stars and gained +180 est. in the last 7 days. The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.

Below are other repos tracked by OSS Radar that share GitHub topics about what they do with trnrt (platform, language and framework tags don't count), ordered by how closely their topics overlap (rarer shared topics count more), then by stars gained this week. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README. Data as of 2026-11-09T19:13:48.951Z (UTC), updated hourly. HTML page: https://ossradar.net/alternatives/RunanywhereAI/trnrt

## Alternatives

| # | Repo | Category | 7 days | Total stars | Shared topics | What it is |
| --- | --- | --- | --- | --- | --- | --- |
| 1 | [vLLM](https://ossradar.net/repo/vllm-project/vllm) (vllm-project/vllm) | LLM tooling | +450 | 96612 | inference, LLM, LLM serving | A high-throughput and memory-efficient inference and serving engine for LLMs. |
| 2 | [project-maya](https://ossradar.net/repo/mw00/project-maya) (mw00/project-maya) | LLM tooling | +303 | 2729 | GLM, LLM, OpenAI API | Run GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard… |
| 3 | [SGLang](https://ossradar.net/repo/sgl-project/sglang) (sgl-project/sglang) | LLM tooling | +235 | 38618 | GLM, inference, LLM | SGLang is a high-performance serving framework for large language models and multimodal models. |
| 4 | [PolyStrata](https://ossradar.net/repo/simplexai-labs/PolyStrata) (simplexai-labs/PolyStrata) | LLM tooling | +166 est. | 949 | GLM, LLM, OpenAI API | Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith… |
| 5 | [ai-infra-book](https://ossradar.net/repo/bojieli/ai-infra-book) (bojieli/ai-infra-book) | LLM tooling | +180 | 7425 | LLM, LLM serving | Open-source book that derives LLM inference and training system design from hardware limits, with calculation tools. |
| 6 | [mojo-dllm](https://ossradar.net/repo/vladimirrott/mojo-dllm) (vladimirrott/mojo-dllm) | LLM tooling | +256 | 504 | inference, LLM | Local inference for diffusion language models (LLaDA, Dream), written in Mojo. |
| 7 | [omlx](https://ossradar.net/repo/jundot/omlx) (jundot/omlx) | LLM tooling | +189 | 23483 | LLM, OpenAI API | LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar. |
| 8 | [Transformers](https://ossradar.net/repo/huggingface/transformers) (huggingface/transformers) | LLM tooling | +234 | 168692 | GLM, LLM | Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models… |

Gains marked est. are estimates for repos first seen less than a week ago. Each repo also has a Markdown page: append .md to its repo URL.

## More

- trnrt repo page: https://ossradar.net/repo/RunanywhereAI/trnrt (Markdown: https://ossradar.net/repo/RunanywhereAI/trnrt.md)
- Alternatives to vLLM: https://ossradar.net/alternatives/vllm-project/vllm.md
- Alternatives to project-maya: https://ossradar.net/alternatives/mw00/project-maya.md
- Alternatives to SGLang: https://ossradar.net/alternatives/sgl-project/sglang.md
- Alternatives to PolyStrata: https://ossradar.net/alternatives/simplexai-labs/PolyStrata.md
- Alternatives to ai-infra-book: https://ossradar.net/alternatives/bojieli/ai-infra-book.md
- Alternatives to mojo-dllm: https://ossradar.net/alternatives/vladimirrott/mojo-dllm.md
- All trending LLM tooling repos: https://ossradar.net/category/llm-tooling.md
- Alternatives to other trending repos: https://ossradar.net/alternatives
- Live leaderboard: https://ossradar.net/ (also https://ossradar.net/llms.txt and https://ossradar.net/api/v1/trending)

Free to cite with a link back to https://ossradar.net/alternatives/RunanywhereAI/trnrt.