Web Scraping

What this skill carries — grep references/ for any subject the names below miss: !d=${CLAUDE_SKILL_DIR}; command -v skill-toc >/dev/null 2>&1 && exec skill-toc "$d"; s=$HOME/.claude/skills/plugin-utils/bin/skill-toc; [ -x "$s" ] && exec "$s" "$d"; echo "(skill-toc unavailable: references and scripts are NOT listed here — install the plugin-utils plugin, or start a new session so its bin/ reaches PATH)"

Bulk fetching from hosts you do not own: how fast you may go, when a paid transport beats a direct fetch, and how to prove the fallback you are relying on has ever run.

Contents

• Iron Law: the rate is computed, not chosen
• Quota vs rate limit
• Verify the fallback before you rely on it
• Direct fetch or paid transport
• Vendor table
• Facts
• Red flags — STOP
• References