Web Scraper

Overview

Extract structured data from web pages by parsing HTML, selecting elements with CSS selectors, and outputting clean data in JSON, CSV, or other formats. Handles both static HTML and JavaScript-rendered pages.

Instructions

When a user asks you to scrape or extract data from a web page, follow these steps:

Step 1: Assess the target

Determine:

• URL: What page to scrape
• Data needed: What specific elements to extract (prices, titles, links, tables)
• Rendering: Is the page static HTML or does it require JavaScript?
• Scale: Single page or multiple pages with pagination?

Step 2: Fetch the page