Site Mapping

Map the complete structure of a website: extract all URLs from sitemaps, analyze navigation hierarchy, classify content by section, and produce a structured overview.

When to Use

• User asks to "map out," "audit," or "review" a website's structure
• Need to understand a site's URL taxonomy, content sections, or SEO footprint
• Preparing competitive analysis, content gap assessment, or migration planning

Workflow

1. Discover sitemaps

Check these in order:

• https://site.com/sitemap.xml (may redirect to sitemap_index.xml)
• https://site.com/robots.txt — look for Sitemap: directive
• Common patterns: /page-sitemap.xml, /post-sitemap.xml, numbered variants (sitemap2.xml)

2. Extract URLs programmatically