Site Content Catalog

Crawl a website's sitemap and blog to build a complete content inventory — every page cataloged with URL, title, date, content type, and topic cluster. Groups content by category, identifies publishing patterns, and optionally deep-analyzes top pages.

Quick Start

# Basic content inventory
python3 skills/site-content-catalog/scripts/catalog_content.py \
  --domain "example.com"

# With deep analysis of top 20 pages
python3 skills/site-content-catalog/scripts/catalog_content.py \
  --domain "example.com" --deep-analyze 20

# Output to specific file
python3 skills/site-content-catalog/scripts/catalog_content.py \
  --domain "example.com" --output clients/acme/research/content-inventory.json