Scrape feasibility audit

Answers two questions before anyone writes a scraper: should we collect this, and what will it take? Getting these wrong is expensive in a specific way — teams build a Playwright cluster for a site that publishes JSON-LD, or spend a week fighting Kasada for data behind an official API that would have taken an afternoon.

The output is a decision, with evidence, not a pile of observations.

Scope

Covers public, unauthenticated content: pages any visitor can reach without logging in.

Outside scope, and worth saying plainly to the user if a request lands here:

• Content behind authentication, paywalls, or purchased access
• Defeating an interactive CAPTCHA that gates the content itself
• Evading a block on a site that has explicitly refused automated access