litellm alternatives

BerriAI/litellm (61k stars, +210 this week): The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails… Why it matters: useful plumbing for shipping LLM-powered features.

Below are 12 other LLM tooling repos tracked by OSS Radar that share at least two GitHub topics with litellm, ordered by how many topics overlap, then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.

1. 1. decolua/9router

   +98/wkest.

   Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Why it matters: useful plumbing for shipping LLM-powered features.

   31k stars · JavaScript · shared topics: ai-gateway, anthropic, llm, llm-gateway, openai, openai-proxy

2. 2. diegosouzapw/OmniRoute

   +658/wkest.

   Never stop coding. Free MIT AI gateway: one endpoint, 359 providers (150+ free), 1200+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek… Why it matters: useful plumbing for shipping LLM-powered features.

   76k stars · TypeScript · shared topics: ai-gateway, anthropic, llm-gateway, openai, openai-proxy

3. 3. headroomlabs-ai/headroom

   +315/wkest.

   Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. Why it matters: useful plumbing for shipping LLM-powered features.

   75k stars · Python · shared topics: anthropic, langchain, llm, openai

4. 4. can1357/oh-my-pi

   +266/wkest.

   ⌥ Coding agent with the IDE wired in. Built by Stencil Labs. Why it matters: useful plumbing for shipping LLM-powered features.

   35k stars · TypeScript · shared topics: anthropic, llm, openai, rust

5. 5. langchain-ai/langchain

   +182/wkest.

   The agent engineering platform. Why it matters: useful plumbing for shipping LLM-powered features.

   148k stars · Python · shared topics: anthropic, langchain, llm, openai

6. 6. lidge-jun/opencodex

   +126/wkest.

   Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK… Why it matters: useful plumbing for shipping LLM-powered features.

   17k stars · TypeScript · shared topics: ai-gateway, anthropic, llm, openai

7. 7. langfuse/langfuse

   +112/wkest.

   🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform. Why it matters: useful plumbing for shipping LLM-powered features.

   36k stars · TypeScript · shared topics: langchain, llm, llmops, openai

8. 8. comet-ml/opik

   +56/wkest.

   Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations… Why it matters: useful plumbing for shipping LLM-powered features.

   23k stars · Python · shared topics: langchain, llm, llmops, openai

9. 9. NousResearch/hermes-agent

   +714/wkest.

   The agent that grows with you. Why it matters: useful plumbing for shipping LLM-powered features.

   254k stars · Python · shared topics: anthropic, llm, openai

10. 10. rtk-ai/rtk

    +252/wkest.

    CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies. Why it matters: useful plumbing for shipping LLM-powered features.

    83k stars · Rust · shared topics: anthropic, llm, rust

11. 11. langchain-ai/langgraph

    +140/wkest.

    Build resilient agents. Why it matters: useful plumbing for shipping LLM-powered features.

    43k stars · Python · shared topics: langchain, llm, openai

12. 12. trailhq/Trail-Code

    +133/wkest.

    Turbocharge Claude Code, Cursor, Codex, Gemini & every coding agent: faster, cheaper, with contextual understanding specific to your… Why it matters: useful plumbing for shipping LLM-powered features.

    10k stars · TypeScript · shared topics: anthropic, llm, openai

More: all trending LLM tooling repos · compare litellm with the top 2