modelscope/evalscope

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking. Why it matters: useful plumbing for shipping LLM-powered features.

GitHub description: A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

View on GitHub WebsiteCompare

Stars

3.5k

Last 24h

Last 7 days

+21est.

Forks

519

Star history

GitHub stars over time. A steeper line means the repo is gaining attention faster.

Daily, since Oct 13, 2026 · 3.5k → 3.5k

* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.

Maintainer? Add the badge to your README

Shows your live OSS Radar rank and links back here. Updates hourly.

[![Trending on OSS Radar](https://ossradar.net/badge/modelscope/evalscope)](https://ossradar.net/repo/modelscope/evalscope)

<a href="https://ossradar.net/repo/modelscope/evalscope"><img src="https://ossradar.net/badge/modelscope/evalscope" alt="Trending on OSS Radar"></a>

About evalscope

modelscope/evalscope is a Python project in the LLM tooling category, created 3 years ago. It has 3.5k GitHub stars and 519 forks, and gained +21 stars over the last 7 days (early estimate), ranking #140 of 168 LLM tooling repos tracked by OSS Radar this week.

Language: Python
Category: LLM tooling
Created: Dec 7, 2023
Last code push: today (Oct 13, 2026)
Latest release: v1.13.0 today

evaluation
llm
performance
rag
vlm

Similar rising repos

Tencent/WeKnora+280est.
Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki. Why it matters: useful plumbing for shipping LLM-powered features.
promptfoo/promptfoo+28est.
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and… Why it matters: useful plumbing for shipping LLM-powered features.
Graphify-Labs/graphify+217est.
Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cursor, Codex… Why it matters: useful plumbing for shipping LLM-powered features.
headroomlabs-ai/headroom+154est.
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same… Why it matters: useful plumbing for shipping LLM-powered features.
virgiliojr94/book-to-skill+140est.
Turn any technical book PDF into a Claude Code skill — ready to study, reference, and use while you work. Why it matters: useful plumbing for shipping LLM-powered features.
open-webui/open-webui+126est.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...). Why it matters: useful plumbing for shipping LLM-powered features.