🍮 crawlbrulee async scrape & webhooks

an async scrape takes the same request body as a sync one, but returns a job_id immediately instead of making you wait. you then either poll for the result or let a webhook tell you it's ready.

new to crawlbrulee? read the crawlbrulee skill first. the request body and the result shape are the sync contract — see crawlbrulee-scrape.

when to go async

• slow pages — heavy JavaScript rendering, or full-page screenshots of very long pages.
• batches — you have many urls and don't want a connection open per url.
• you'd rather be called than poll — attach a webhook and react on completion.

for a single quick fetch, stay synchronous. it's simpler and you get the content in one call.

the lifecycle

three steps: submit → poll status → fetch result.