OSS Radar
D4Vinci/Scrapling
An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here… Why it matters: extends what MCP-compatible assistants can connect to and do.
GitHub description: 🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Stars
87k
Last 24h
+120est.
Last 7 days
+837est.
Forks
8.9k
Who it's for
Developers and data engineers who need to extract data from websites, from one-off scripts to large concurrent crawls, including sites with anti-bot protection or frequently changing layouts.
- Scraping pages whose layout changes, using adaptive selectors that relocate elements after site updates
- Fetching pages protected by anti-bot systems such as Cloudflare Turnstile
- Running concurrent, multi-session crawls with pause/resume and automatic proxy rotation
Star history (last 1 snapshot)
Only one snapshot so far. The chart fills in as OSS Radar collects daily snapshots.
* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.
Maintainer? Add the badge to your README
Shows your live OSS Radar rank and links back here. Updates hourly.
[](https://ossradar.net/repo/D4Vinci/Scrapling)<a href="https://ossradar.net/repo/D4Vinci/Scrapling"><img src="https://ossradar.net/badge/D4Vinci/Scrapling" alt="Trending on OSS Radar"></a>About Scrapling
D4Vinci/Scrapling is a Python project in the MCP category, created 2 years ago. It has 87k GitHub stars and 8.9k forks, and gained +837 stars over the last 7 days (early estimate), ranking #8 of 35 MCP repos tracked by OSS Radar this week.
See more trending MCP repos or the top AI repos this week.
- Language
- Python
- Category
- MCP
- Created
- Oct 13, 2024
- Last push
- Oct 12, 2026
- ai
- ai-scraping
- automation
- crawler
- crawling
- crawling-python
- data
- data-extraction
- mcp
- mcp-server
- playwright
- python
- scraping
- selectors
- stealth
- web-scraper
- web-scraping
- web-scraping-python
- webscraping
- xpath
Similar rising repos
- firecrawl/firecrawl+1.5kest.
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. Why it matters: worth a look if you build or run autonomous agents.
- feder-cr/invisible_playwright_mcp+1.4kest.
Playwright MCP server undetected by anti-bots and captchas: AI agent browses the web on anti-detect stealth Firefox, Python, undetected browser… Why it matters: extends what MCP-compatible assistants can connect to and do.
- sansan0/TrendRadar+826est.
AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, and smart alerts. 告别信息过载，你的 AI 舆情监控助手与热点筛选工具！聚合多平台热点 + RSS… Why it matters: extends what MCP-compatible assistants can connect to and do.
- unclecode/crawl4ai+674est.
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with… Why it matters: useful plumbing for shipping LLM-powered features.
- 2akouwu/reverify+206est.
Stop your AI from making things up — it proposes, deterministic tools decide, every claim checked against ground truth with evidence. Grounded facts… Why it matters: extends what MCP-compatible assistants can connect to and do.
- n8n-io/n8n+543est.
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations. Why it matters: extends what MCP-compatible assistants can connect to and do.