scrapling
Installation
SKILL.md
Scrapling -- Local Stealth Web Scraping
100% local Python library (BSD-3, D4Vinci/Scrapling). No API keys, no cloud dependencies. Built-in Cloudflare solver, TLS impersonation, and adaptive element tracking.
When to Use Scrapling vs Firecrawl
| Need | Use | Why |
|---|---|---|
| Clean markdown from a URL | firecrawl scrape --only-main-content |
Optimized for LLM markdown conversion |
| Bypass Cloudflare/anti-bot | scrapling stealth fetch |
Built-in Turnstile solver, Patchright stealth |
| Extract specific elements | scrapling with CSS/XPath selectors |
Element-level precision, adaptive tracking |
| No API key available | scrapling |
100% local, zero credentials |
| Batch cloud scraping | firecrawl crawl / batch-scrape |
Cloud infrastructure, parallel processing |
| Site redesign resilience | scrapling adaptive mode |
SQLite-backed similarity matching |
| Full-site concurrent crawl | scrapling Spider framework |
Scrapy-like with pause/resume |
| Web search + scrape | firecrawl search --scrape |
Combined search + extraction |