{"name":"Scrapling","repo":"D4Vinci/Scrapling","url":"https://midorreal.com/project/d4vinci-scrapling","repository":"https://github.com/D4Vinci/Scrapling","description":"🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev","facts":{"license":{"value":"BSD-3-Clause","source":"https://github.com/D4Vinci/Scrapling","checked":"22 Nov 2026"},"language":{"value":"Python","source":"https://github.com/D4Vinci/Scrapling","checked":"22 Nov 2026"},"homepage":{"value":"https://scrapling.readthedocs.io/en/latest/","source":"https://scrapling.readthedocs.io/en/latest/","checked":"22 Nov 2026"},"last_release":{"value":"v0.5.1, 4 Nov 2026","source":"https://github.com/D4Vinci/Scrapling/releases","checked":"22 Nov 2026"},"releases":{"value":"55","source":"https://github.com/D4Vinci/Scrapling/releases","checked":"20 Nov 2026"},"contributors":{"value":"53","source":"https://github.com/D4Vinci/Scrapling/graphs/contributors","checked":"20 Nov 2026"},"archived":{"value":"no","source":"https://github.com/D4Vinci/Scrapling","checked":"22 Nov 2026"}},"stars":104885.0,"writeup":{"what_it_is":"Scrapling is a Python web scraping framework. It combines HTTP requests, stealth browsers, JavaScript rendering, parsing with CSS, XPath, text and regex selectors, and concurrent crawling (spiders) with proxy rotation, retries, and JSON/JSONL/CSV/XML exports. It can also be used from the terminal or through an MCP server and Agent Skill for AI agents.","audience":"Developers and data collectors who need to scrape websites with Python","claims":[{"kind":"specific","claim":"Fetches pages with HTTP requests and stealth browsers, including JavaScript rendering","excerpt":"Fast HTTP requests, stealth browsers, JavaScript rendering, Cloudflare Turnstile/Interstitial handling","status":"not_checked"},{"kind":"specific","claim":"Handles Cloudflare Turnstile and Interstitial challenges","excerpt":"Cloudflare Turnstile/Interstitial handling, persistent sessions, and background API capture","status":"not_checked"},{"kind":"specific","claim":"Supports concurrent spiders with proxy rotation, retries, and pause/resume","excerpt":"Build crawlers with reusable sessions, proxy rotation, automatic retries, pause/resume, and built-in data exports","status":"not_checked"},{"kind":"specific","claim":"Exports scraped data to JSON, JSONL, CSV and XML","excerpt":"JSON/JSONL/CSV/XML exports","status":"not_checked"},{"kind":"specific","claim":"Provides an MCP server and Agent Skill for AI agents to browse and extract data","excerpt":"An MCP server for AI agents to browse and extract data, an Agent Skill, CLI commands, and an interactive shell.","status":"not_checked"}],"alternatives":[],"written_by":"AI, from the project's README","date":"2026-10-27"},"why_now":null,"owner_supplied":null,"score":{"verdict":"real","hype":90,"reality":80,"gap":11,"momentum":0.5,"confidence":85,"version":"score-2.0","rule":"verdict-2.0","calculated_at":"2026-11-22T08:00:00+00:00","verdict_source":"rule"},"early_read":null,"changes":[{"date":"2026-11-04T20:29:16+00:00","text":"Latest release v0.5.1","source":"https://github.com/D4Vinci/Scrapling/releases"},{"date":"2024-10-13T22:01:28+00:00","text":"First release","source":"https://github.com/D4Vinci/Scrapling/releases"},{"date":"2024-10-13T20:29:53+00:00","text":"Repository created","source":"https://github.com/D4Vinci/Scrapling"}],"cite":"Scrapling is a GitHub project at https://github.com/D4Vinci/Scrapling written mainly in Python, described there as \"🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev\".","attribution":"Data from Mid or Real, https://midorreal.com/project/d4vinci-scrapling, checked 22 November 2026. Attribution with a link is required.","still_real":null}