OSS Radar
Back

trnrt alternatives

RunanywhereAI/trnrt (258 stars, +180 this week): The open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.

Below are 8 other LLM tooling repos tracked by OSS Radar that share at least two GitHub topics about what they do with trnrt (platform, language and framework tags don't count), ordered by how closely their topics overlap (rarer shared topics count more), then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.

  1. 1. vLLMvllm-project/vllm

    +450/wk

    A high-throughput and memory-efficient inference and serving engine for LLMs.

    97k stars · Python · shared topics: inference, LLM, LLM serving · vLLM alternatives

  2. 2. project-mayamw00/project-maya

    +303/wk

    Run GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard…

    2.7k stars · C++ · shared topics: GLM, LLM, OpenAI API · project-maya alternatives

  3. 3. SGLangsgl-project/sglang

    +235/wk

    SGLang is a high-performance serving framework for large language models and multimodal models.

    39k stars · Python · shared topics: GLM, inference, LLM · SGLang alternatives

  4. 4. PolyStratasimplexai-labs/PolyStrata

    +166/wkest.

    Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith…

    949 stars · C++ · shared topics: GLM, LLM, OpenAI API · PolyStrata alternatives

  5. 5. ai-infra-bookbojieli/ai-infra-book

    +180/wk

    Open-source book that derives LLM inference and training system design from hardware limits, with calculation tools.

    7.4k stars · Python · shared topics: LLM, LLM serving · ai-infra-book alternatives

  6. 6. mojo-dllmvladimirrott/mojo-dllm

    +256/wk

    Local inference for diffusion language models (LLaDA, Dream), written in Mojo.

    504 stars · Python · shared topics: inference, LLM · mojo-dllm alternatives

  7. 7. omlxjundot/omlx

    +189/wk

    LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar.

    23k stars · Python · shared topics: LLM, OpenAI API · omlx alternatives

  8. 8. Transformershuggingface/transformers

    +234/wk

    Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models…

    169k stars · Python · shared topics: GLM, LLM · Transformers alternatives

More: all trending LLM tooling repos · trending LLM repos · compare trnrt with the top 2 · alternatives to other trending repos