Trending LLM tooling repos
SDKs, prompt tooling, evals, gateways, fine-tuning and inference libraries.
OSS Radar tracks 167 LLM tooling repos that together gained about 156k stars in the last 7 days. Leading this week: DietrichGebert/ponytail, Niko1221/Strata and affaan-m/ECC.
* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.
- 1DietrichGebert/ponytail
Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingJavaScript★ 162k
+1.3k*
stars today
- 2Niko1221/Strata
Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingC++★ 23k
+1.2k*
stars today
- 3affaan-m/ECC
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingJavaScript★ 278k
+1k*
stars today
- 4mhtsec/ARTEX
AI 自主渗透测试系统 | 百度“agent+”攻防挑战赛冠军项目. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingGo★ 3.8k
+717*
stars today
- 5Ebony-Vinyl/dsh-our-free-model
在 dsh 里装上这个插件即可,无需登录、注册或填 API Key,就能使用包括 DeepSeek V4.1 Flash、Kimi K3 在内的前沿模型——完全免费,不限量。 All you do is install this plugin in dsh: no login, no… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingJavaScript★ 13k
+713*
stars today
- 6onehumanbeing/esp32-iphone-agent
Let an AI model use a real iPhone with a $7 ESP32: AirPlay eyes, USB HID hands, any OpenAI-compatible vision model. No Mac, no developer account, no… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 1.2k
+697*
stars today
- 7Graphify-Labs/graphify
Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cursor, Codex… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 126k
+653*
stars today
- 8zhuyansen/new-term-radar
Daily radar for new AI terms: names of new models, products and repos, caught on X, Hugging Face, GitHub and sitemaps before keyword tools list them. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 796
+639*
stars today
- 9JuliusBrussee/caveman
why use many token when few token do trick. Viral skill + proxy for coding agents that cuts 65% of tokens by talking like a caveman. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingGo★ 111k
+580*
stars today
- 10NousResearch/hermes-agent
The agent that grows with you. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 253k
+566*
stars today
- 11KKKKhazix/AIHOT
一个自己找热点、自己写日报的网站框架。把信源和精选标准换成你的,它就是你的行业热点站。 Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingTypeScript★ 7.5k
+514*
stars today
- 12LosaLosSantos/aurelio-finance
Open-source personal finance app with an AI financial advisor: track your net worth, investments, ETFs, cash and debts on your own computer. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 3.1k
+459*
stars today
- 13guillaumemeyer/watermarks-remover
A privacy-first app that strips AI watermarks from content you own. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 24k
+382*
stars today
- 14jev-chat/jev-chat-jarvis
The chat decision assistant: before you reply, Jev reads the chat, judges intent and risk, and drafts replies you fill in with one tap. You press… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingKotlin★ 7.7k
+349*
stars today
- 15rohitg00/ai-engineering-from-scratch
Learn AI Engineering! Learn it. Build it. Ship it for others. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 68k
+328*
stars today
- 16omlahore/RemoveMacAI
Debloat macOS: turn off Apple Intelligence, analytics, ads and pop-ups. A native app and CLI, and every change can be undone. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingSwift★ 4.5k
+323*
stars today
- 17rtk-ai/rtk
CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingRust★ 83k
+315*
stars today
- 18diegosouzapw/OmniRoute
Never stop coding. Free MIT AI gateway: one endpoint, 359 providers (150+ free), 1200+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingTypeScript★ 76k
+314*
stars today
- 19MemPalace/mempalace
The best-benchmarked open-source AI memory system. And it's free. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 60k
+311*
stars today
- 20headroomlabs-ai/headroom
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 75k
+270*
stars today
- 21thedotmack/claude-mem
Persistent Context Across Sessions for Every Agent – Captures everything your agent does during sessions, compresses it with AI, and injects relevant… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingTypeScript★ 100k
+246*
stars today
- 22nykooi1/vibe-wise
A Claude Code / Codex plugin that helps you learn how to build while AI writes the code. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 3.5k
+242*
stars today
- 23ZhuLinsen/daily_stock_analysis
LLM 驱动的多市场股票智能分析系统:多源行情、实时新闻、决策看板与自动推送,支持零成本定时运行。 LLM-powered multi-market stock analysis system with multi-source market data, real-time news… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 66k
+240*
stars today
- 24Jakeschincariol/replica-skill
Eleven free Claude skills that clone any app: reverse-engineer it, rebuild it, test it for bugs, then fix what its users hate. Free, MIT. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 2.3k
+227*
stars today
- 25lnkiai/m3e-canvas
Sketch Material 3 Expressive screens in the browser and turn them into vibe-coding prompts. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingTypeScript★ 9.3k
+225*
stars today
- 26code-yeongyu/oh-my-openagent
OmO: Just type "mass ulw" keyword with your prompt. Now you are the master of graph engineering. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingTypeScript★ 70k
+223*
stars today
- 27MadsLorentzen/ai-job-search
The job search that runs on your machine. AI job application framework built on Claude Code: evaluate postings, tailor CVs, write cover letters, prep… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 46k
+222*
stars today
- 28virgiliojr94/book-to-skill
Turn any technical book PDF into a Claude Code skill — ready to study, reference, and use while you work. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 35k
+210*
stars today
- 29deeplethe/solid-glass
A design system for AI applications. Material, physical, tactile, technical. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingTypeScript★ 238
+206*
stars today
- 30yc-software/qm
Multiplayer agent harness for work. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingTypeScript★ 15k
+203*
stars today
- 31google-gemini/gemini-cli
An open-source AI agent that brings the power of Gemini directly into your terminal. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingTypeScript★ 107k
+197*
stars today
- 32Albert-Weasker/niubigeo
Open-source AI brand visibility and competitor reports. Official website: https://niubigeo.ai/ | Paid services: AI testing by real people and GEO… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingTypeScript★ 7.6k
+190*
stars today
- 33miuuyy/codex-chatgpt-web
Use ChatGPT Web (including Pro) as a native model in Codex — with context, tools, streaming and images, without using Codex quota. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingTypeScript★ 14k
+179*
stars today
- 34kaankiziltug/logo-design-skill
A comprehensive logo-design skill for Claude, Gemini CLI, Codex and other AI agents: principles, process, SVG craft, testing tools and a 1,400+ logo… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingHTML★ 3k
+177*
stars today
- 35trhhubsd/ARTEXX
AI 自主渗透测试系统 | 百度“agent+”攻防挑战赛冠军项目 Autumn-27/ARTEX. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingGo★ 812
+173*
stars today
- 36FlashML-org/FreeToken
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 14k
+171*
stars today
- 37XiaoDuoYa/codex-with-chatgpt
ChatGPT thinks. Codex works. Use ChatGPT as the planning brain while keeping the Codex harness. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingTypeScript★ 7.3k
+159*
stars today
- 38AlexsJones/llmfit
Hundreds of models & providers. One command to find what runs on your hardware. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingRust★ 38k
+158*
stars today
- 39yi1108/printfilm
PRINTFILM: AI short-video marketing and AI short-drama creation platform. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 5.1k
+154*
stars today
- 40ollama/ollama
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingGo★ 183k
+152*
stars today
- 41lidge-jun/opencodex
Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingTypeScript★ 17k
+149*
stars today
- 42Significant-Gravitas/AutoGPT
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 188k
+143*
stars today
- 43jiwoochris/artex-ko
ARTEX 한국어판 · AI 자율 침투 테스트 프레임워크(upstream: Autumn-27/ARTEX, AGPL-3.0). Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingGo★ 1.4k
+143*
stars today
- 44open-webui/open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...). Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 156k
+141*
stars today
- 45harry0703/MoneyPrinterTurbo
利用 AI 大模型和自动化工作流,根据主题或关键词一键生成高清短视频。Generate HD short videos from a topic or keyword with an automated AI workflow. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 130k
+138*
stars today
- 46asgeirtj/system_prompts_leaks
Documented system prompts from Anthropic - Claude Fable 5.1, Opus 5.5, Claude Design, Claude Code. OpenAI - ChatGPT GPT-6-Astra, Codex. Google… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 70k
+132*
stars today
- 47langgenius/dify
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingTypeScript★ 158k
+124*
stars today
- 48lemomo-ai/lemo-opuscar
Claude Code skill for short films with no video model: 43 film styles, each a style prompt plus a demo film made entirely in code by Claude Opus 5.5… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingJavaScript★ 2.1k
+124*
stars today
- 49f/prompts.chat
f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingHTML★ 173k
+123*
stars today
- 50can1357/oh-my-pi
⌥ Coding agent with the IDE wired in. Built by Stencil Labs. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingTypeScript★ 35k
+123*
stars today