rotate-scraping-proxies

Installation
SKILL.md

Rotate Scraping Proxies

Network-layer escalation for scraping campaigns where client-side stealth has already been exhausted. Proxy rotation is a last resort, not a default — it is expensive, ethically charged, and easily misused. This skill teaches when not to use it as much as how to use it well.

When to Use

  • headless-web-scraping (Fetcher → StealthyFetcher → DynamicFetcher) has been tried and the target still returns 403/429/geo-blocks
  • Rate limiting is already at 3+ second intervals and robots.txt permits the path
  • The User-Agent and TLS fingerprint are already realistic (not the default python-requests)
  • Your scraping is legitimate: public data, no auth circumvention, no paywall bypass, no personal data harvested without legal basis
  • You can budget for proxy traffic and accept the operational complexity
Installs
1
GitHub Stars
32
First Seen
Jun 12, 2026
rotate-scraping-proxies — pjt222/agent-almanac