Web Scraper

High-performance web scraping using crawl4ai. Handles JavaScript rendering, bypasses anti-bot protections (Cloudflare), and extracts clean markdown or structured data.

Requirements

Before using this skill, ensure crawl4ai is installed:

pip install crawl4ai>=0.7.0
crawl4ai-setup  # Downloads Playwright browsers

Quick Start

Basic URL Crawling

For a single URL with markdown extraction: