crawl4ai alternatives

unclecode/crawl4ai (85k stars, +140 this week): Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Why it matters: useful plumbing for shipping LLM-powered features.

Below are 12 other LLM tooling repos tracked by OSS Radar that share at least two GitHub topics with crawl4ai, ordered by how many topics overlap, then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.

1. 1. langchain-ai/langchain

   +161/wkest.

   The agent engineering platform. Why it matters: useful plumbing for shipping LLM-powered features.

   148k stars · Python · shared topics: ai, ai-agents, llm, open-source, python, rag

2. 2. langchain-ai/langgraph

   +119/wkest.

   Build resilient agents. Why it matters: useful plumbing for shipping LLM-powered features.

   43k stars · Python · shared topics: ai, ai-agents, llm, open-source, python, rag

3. 3. rohitg00/ai-engineering-from-scratch

   +889/wkest.

   Learn AI Engineering! Learn it. Build it. Ship it for others. Why it matters: useful plumbing for shipping LLM-powered features.

   69k stars · Python · shared topics: ai, ai-agents, llm, mcp, python

4. 4. headroomlabs-ai/headroom

   +266/wkest.

   Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. Why it matters: useful plumbing for shipping LLM-powered features.

   75k stars · Python · shared topics: ai, llm, mcp, python, rag

5. 5. mem0ai/mem0

   +56/wkest.

   The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production. Why it matters: useful plumbing for shipping LLM-powered features.

   67k stars · Python · shared topics: ai, ai-agents, llm, python, rag

6. 6. amitshekhariitbhu/ai-engineering-interview-questions

   +42/wkest.

   Your Cheat Sheet for AI Engineering Interview – Questions and Answers. Why it matters: useful plumbing for shipping LLM-powered features.

   3.4k stars · Markdown · shared topics: ai, ai-agents, llm, mcp, rag

7. 7. Graphify-Labs/graphify

   +392/wkest.

   Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. Why it matters: useful plumbing for shipping LLM-powered features.

   126k stars · Python · shared topics: ai-agents, llm, mcp, rag

8. 8. open-webui/open-webui

   +175/wkest.

   User-friendly AI Interface (Supports Ollama, OpenAI API, ...). Why it matters: useful plumbing for shipping LLM-powered features.

   156k stars · Python · shared topics: ai, llm, mcp, rag

9. 9. langgenius/dify

   +126/wkest.

   Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Why it matters: useful plumbing for shipping LLM-powered features.

   158k stars · TypeScript · shared topics: ai, llm, mcp, python

10. 10. trailhq/Trail-Code

    +119/wkest.

    Turbocharge Claude Code, Cursor, Codex, Gemini & every coding agent: faster, cheaper, with contextual understanding specific to your… Why it matters: useful plumbing for shipping LLM-powered features.

    10k stars · TypeScript · shared topics: ai-agents, llm, mcp, open-source

11. 11. AstrBotDevs/AstrBot

    +98/wkest.

    AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw… Why it matters: useful plumbing for shipping LLM-powered features.

    42k stars · Python · shared topics: ai, llm, mcp, python

12. 12. repowise-dev/repowise

    +84/wkest.

    Codebase intelligence for AI and humans: code health scores, auto-generated docs, git analytics, dead code detection, and architectural… Why it matters: useful plumbing for shipping LLM-powered features.

    7.7k stars · Python · shared topics: ai, mcp, open-source, python

More: all trending LLM tooling repos · compare crawl4ai with the top 2