rotate-scraping-proxies
Installation
SKILL.md
Rotate Scraping Proxies
Network-layer escalation for scraping campaigns where client-side stealth has already been exhausted. Proxy rotation is a last resort, not a default — it is expensive, ethically charged, and easily misused. This skill teaches when not to use it as much as how to use it well.
When to Use
headless-web-scraping(Fetcher → StealthyFetcher → DynamicFetcher) has been tried and the target still returns 403/429/geo-blocks- Rate limiting is already at 3+ second intervals and
robots.txtpermits the path - The User-Agent and TLS fingerprint are already realistic (not the default
python-requests) - Your scraping is legitimate: public data, no auth circumvention, no paywall bypass, no personal data harvested without legal basis
- You can budget for proxy traffic and accept the operational complexity