scrapling
Installation
SKILL.md
scrapling - Adaptive Web Scraping Framework
Keyword:
scrapling·adaptive scraping·stealthy fetch·scrapling spiderRespect each target site's terms, robots, rate limits, and authorization boundaries.
Scrapling is a Python scraping framework for parser-first HTML extraction, browser-backed fetching, stealth anti-bot handling, CLI prototyping, and optional larger crawl workflows. Its distinctive feature is adaptive scraping: you can save element fingerprints and later relocate equivalent elements after a site redesign.
When to use this skill
- Install Scrapling with the right extras for parser-only, fetchers, shell, AI, or full usage
- Parse known HTML with
Selectorbefore escalating to browser-backed fetchers - Choose between
Fetcher,DynamicFetcher, andStealthyFetcher - Reuse
FetcherSession,DynamicSession, orStealthySessionfor multiple requests - Parse HTML with CSS, XPath,
::text,::attr(...), text matching, regex, and similar-element lookup - Enable adaptive scraping with
adaptive=True,auto_save=True,retrieve(), andrelocate() - Use the
scraplingCLI for terminal-first extraction or shell work - Understand MCP and spiders as second-tier workflows once core scraping is working
- Decide when Docker-only CLI usage is enough versus when Python code is required