Crawl a site

A crawl observes what the configured fetcher could discover and retrieve during one run. It is the foundation for most technical reports, but it is not an index, traffic source, or guarantee of complete site coverage. Set a deliberate page and depth budget, then save the snapshot when later analysis must share the same evidence.

Run it

For MCP, call seo_list_reports with category crawl when discovery is needed. Call seo_describe_report with { "id": "crawl-site" }, then seo_run_report with:

{
  "id": "crawl-site",
  "params": {
    "url": "https://example.com/",
    "maxPages": 100,
    "maxDepth": 3,
    "saveReport": true
  }
}