E-commerce Extraction

General Patterns

• Check for sitemap.xml first -- many stores list all product URLs
• Look for /products.json, /api/products, or similar API endpoints before scraping HTML
• Product listing pages usually paginate: look for ?page=N, ?offset=N, or "Load more" buttons
• Always check the total count shown on the page vs what you've extracted

Product Data Checklist

• Name, brand, SKU/ID
• Price (current, original/compare-at, currency)
• Variants (size, color, etc.) with per-variant pricing and availability
• Images (primary + gallery)
• Description (short + long)
• Category/breadcrumb path
• Availability/stock status
• Ratings and review count

Pagination