Web Scraper & Data Miner

This skill enables bionicbot to gather data from the web and transform it into structured formats (JSON, CSV).

Instructions

1. Use tools like crawl_tool or bash with Playwright/Cheerio.
2. Handle pagination and dynamic content (JavaScript rendering).
3. Respect robots.txt and implement rate limiting.
4. Clean and validate extracted data.
5. Output data in a format ready for analysis or database import.

Examples

• "Scrape the latest real estate listings from a specific area."
• "Extract pricing data for a competitor's product catalog."