Scrapling — Adaptive Web Scraping

Python web scraping framework (D4Vinci) with adaptive element tracking, 4 fetcher types (static → dynamic → stealth), Scrapy-like spiders, MCP server, and CLI. Adapts to site changes — CSS selectors that worked yesterday still work today even if the site restructured.

When to use this skill

• Scrape websites that change layout or restructure HTML over time (adaptive mode)
• Bypass anti-bot protection and Cloudflare Turnstile (StealthyFetcher)
• Run concurrent crawls with pause/resume across thousands of pages (Spider)
• Fetch rendered JavaScript-heavy pages (DynamicFetcher)
• Connect via MCP to provide browser automation tools to AI agents
• Quick one-off scraping from CLI (scrapling shell, scrapling extract)

Instructions