Topic

Trending web scraping repos

Repos whose maintainers tagged them web-scraping on GitHub (topics are labels that describe what a project is about), ranked by stars gained.

10 repos gained about 7.8k stars in the last 7 days. Leading this week: firecrawl/firecrawl, lexmount/moli and D4Vinci/Scrapling.

10 repos tracked · ranked by stars gained · updated hourly

* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.

1
firecrawl/firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥.
AI agentsTypeScript★ 193k
+1.9k
stars this week
2
lexmount/moli
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust.
AI agentsRust★ 20k
+1.7k
stars this week
3
D4Vinci/Scrapling
🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl!
MCPPython★ 89k
+1.4k
stars this week
4
JCodesMore/ai-website-cloner-template
Clone any website with one command using AI coding agents.
Coding agentsTypeScript★ 37k
+1.2k*
stars this week
5
browser-use/browser-use
Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.
AI agentsPython★ 119k
+669
stars this week
6
unclecode/crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown.
LLM toolingPython★ 86k
+405
stars this week
7
CloakHQ/CloakBrowser
Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches.
AI agentsPython★ 32k
+161
stars this week
8
cporter202/API-mega-list
This GitHub repo is a powerhouse collection of APIs you can start using immediately to build everything from simple automations to…
MCPJavaScript★ 7.9k
+144
stars this week
9
ovobrowsersupport/ovobrowser
Source-level Chromium fingerprint kernel that passes bot detection tests. Not JS injection C++ patches compiled into the binary.
AI agents★ 1k
+110
stars this week
10
MODSetter/SurfSense
Air-gapped, privacy-focused, open-source NotebookLM alternative. AI agent that researches, transforms, and edits your documents.
AI agentsPython★ 17k
+109
stars this week