comet-ml/opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and… Why it matters: useful plumbing for shipping LLM-powered features.
GitHub description: Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Stars
23k
Last 24h
+2
Last 7 days
+14est.
Forks
1.9k
Star history
GitHub stars over time. A steeper line means the repo is gaining attention faster.
Daily, since Oct 13, 2026 · 23k → 23k
* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.
Discussed on Hacker News
Hacker News is a popular tech discussion site. 5 stories link to this repo, with 96 upvotes (points) in total.
Show HN: Opik, an open source LLM evaluation framework86 points · 15 comments · Sep 17, 2024See all 5 on HN search →Maintainer? Add the badge to your README
Shows your live OSS Radar rank and links back here. Updates hourly.
[](https://ossradar.net/repo/comet-ml/opik)<a href="https://ossradar.net/repo/comet-ml/opik"><img src="https://ossradar.net/badge/comet-ml/opik" alt="Trending on OSS Radar"></a>About opik
comet-ml/opik is a Python project in the LLM tooling category, created 3 years ago. It has 23k GitHub stars and 1.9k forks, and gained +14 stars over the last 7 days (early estimate), ranking #94 of 162 LLM tooling repos tracked by OSS Radar this week.
See more trending LLM tooling repos or the top AI repos this week.
- Language
- Python
- Category
- LLM tooling
- Created
- May 10, 2023
- Last code push
- today (Oct 14, 2026)
- Latest release
- 2.2.99 today
- evaluation
- hacktoberfest
- hacktoberfest2025
- langchain
- llama-index
- llm
- llm-evaluation
- llm-observability
- llmops
- open-source
- openai
- playground
- prompt-engineering
Similar rising repos
- langfuse/langfuse+21est.
Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform. Why it matters: useful plumbing for shipping LLM-powered features.
- headroomlabs-ai/headroom+77est.
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same… Why it matters: useful plumbing for shipping LLM-powered features.
- BerriAI/litellm+21est.
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load… Why it matters: useful plumbing for shipping LLM-powered features.
- langchain-ai/langgraph+7est.
Build resilient agents. Why it matters: useful plumbing for shipping LLM-powered features.
- f/prompts.chat+42est.
f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with… Why it matters: useful plumbing for shipping LLM-powered features.
Documented system prompts from Anthropic - Claude Fable 5.1, Opus 5.5, Claude Design, Claude Code. OpenAI - ChatGPT GPT-6-Astra, Codex. Google… Why it matters: useful plumbing for shipping LLM-powered features.