scrapling
scrapling - Adaptive Web Scraping Framework
Keyword:
scrapling·adaptive scraping·stealthy fetch·scrapling spiderRespect each target site's terms, robots, rate limits, and authorization boundaries.
Scrapling is a Python scraping framework for parser-first HTML extraction, browser-backed fetching, stealth anti-bot handling, CLI prototyping, and optional larger crawl workflows. Its distinctive feature is adaptive scraping: you can save element fingerprints and later relocate equivalent elements after a site redesign.
When to use this skill
- Install Scrapling with the right extras for parser-only, fetchers, shell, AI, or full usage
- Parse known HTML with
Selectorbefore escalating to browser-backed fetchers - Choose between
Fetcher,DynamicFetcher, andStealthyFetcher - Reuse
FetcherSession,DynamicSession, orStealthySessionfor multiple requests - Parse HTML with CSS, XPath,
::text,::attr(...), text matching, regex, and similar-element lookup - Enable adaptive scraping with
adaptive=True,auto_save=True,retrieve(), andrelocate() - Use the
scraplingCLI for terminal-first extraction or shell work - Understand MCP and spiders as second-tier workflows once core scraping is working
- Decide when Docker-only CLI usage is enough versus when Python code is required
More from akillness/skills-template
backend-testing
>
71data-analysis
>
54plannotator
>
35task-planning
Plan and organize software development tasks effectively. Use when breaking down features, creating user stories, or planning sprints. Handles task breakdown, user stories, acceptance criteria, and backlog management.
35omc
Use when you need Teams-first multi-agent orchestration in Claude Code. Triggers on: omc, autopilot, ralph, ulw, ccg, team. 29+ specialized agents, smart model routing (Haiku→Opus), persistent execution loops, skill layers, real-time HUD.
33vibe-kanban
Manage AI coding agents on a visual Kanban board. Run parallel agents through a To Do→In Progress→Review→Done flow with automatic git worktree isolation and GitHub PR creation.
32