evalscope alternatives

modelscope/evalscope (3.5k stars, +35 this week): A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking. Why it matters: useful plumbing for shipping LLM-powered features.

Below are 12 other LLM tooling repos tracked by OSS Radar that share at least two GitHub topics with evalscope, ordered by how many topics overlap, then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.

1. 1. Tencent/WeKnora

   +553/wkest.

   Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki. Why it matters: useful plumbing for shipping LLM-powered features.

   34k stars · Go · shared topics: evaluation, llm, rag

2. 2. promptfoo/promptfoo

   +56/wkest.

   Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Why it matters: useful plumbing for shipping LLM-powered features.

   26k stars · TypeScript · shared topics: evaluation, llm, rag

3. 3. Graphify-Labs/graphify

   +392/wkest.

   Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. Why it matters: useful plumbing for shipping LLM-powered features.

   126k stars · Python · shared topics: llm, rag

4. 4. headroomlabs-ai/headroom

   +266/wkest.

   Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. Why it matters: useful plumbing for shipping LLM-powered features.

   75k stars · Python · shared topics: llm, rag

5. 5. virgiliojr94/book-to-skill

   +196/wkest.

   Turn any technical book PDF into a Claude Code skill — ready to study, reference, and use while you work. Why it matters: useful plumbing for shipping LLM-powered features.

   35k stars · Python · shared topics: llm, rag

6. 6. open-webui/open-webui

   +175/wkest.

   User-friendly AI Interface (Supports Ollama, OpenAI API, ...). Why it matters: useful plumbing for shipping LLM-powered features.

   156k stars · Python · shared topics: llm, rag

7. 7. langchain-ai/langchain

   +161/wkest.

   The agent engineering platform. Why it matters: useful plumbing for shipping LLM-powered features.

   148k stars · Python · shared topics: llm, rag

8. 8. unclecode/crawl4ai

   +140/wkest.

   Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Why it matters: useful plumbing for shipping LLM-powered features.

   85k stars · Python · shared topics: llm, rag

9. 9. langchain-ai/langgraph

   +119/wkest.

   Build resilient agents. Why it matters: useful plumbing for shipping LLM-powered features.

   43k stars · Python · shared topics: llm, rag

10. 10. langfuse/langfuse

    +91/wkest.

    🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform. Why it matters: useful plumbing for shipping LLM-powered features.

    36k stars · TypeScript · shared topics: evaluation, llm

11. 11. sgl-project/sglang

    +77/wkest.

    SGLang is a high-performance serving framework for large language models and multimodal models. Why it matters: useful plumbing for shipping LLM-powered features.

    37k stars · Python · shared topics: llm, vlm

12. 12. huggingface/transformers

    +70/wkest.

    🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models… Why it matters: useful plumbing for shipping LLM-powered features.

    168k stars · Python · shared topics: llm, vlm

More: all trending LLM tooling repos · compare evalscope with the top 2