Scrapfly Scraper

Use the Scrapfly Scraper API to collect web page data with proxy rotation, anti-bot bypass, JavaScript rendering, and JavaScript scenarios for browser control.

When to use

• Scraping web pages (HTML, JSON, text, markdown)
• Bypassing anti-bot protections (Cloudflare, DataDome, PerimeterX, Kasada, and more)
• Collecting data through rotating proxies with geo-targeting
• Rendering JavaScript-heavy pages with headless browsers
• Control the browser using JavaScript scenario for common actions (waiting for selectors, clicking, filling elements, etc.)
• Session-reuse for session-presited scraping
• Capturing browser XHR call data

Setup

pip install scrapfly-sdk