scrapfly-sdk-go
Installation
SKILL.md
Scrapfly Go SDK
Use the go-scrapfly module to scrape web pages from Go with proxy rotation,
anti-bot bypass (Unblocker), JavaScript rendering, screenshots, and AI extraction.
It ships a built-in goquery selector for parsing the response.
When to use
- Scraping web pages (HTML, JSON, text, markdown) from a Go codebase
- Bypassing anti-bot protections (Cloudflare, DataDome, PerimeterX, Kasada)
- Rendering JavaScript-heavy pages with a headless browser
- Capturing screenshots or extracting structured data
Setup
go get github.com/scrapfly/go-scrapfly
export SCRAPFLY_API_KEY="your-api-key"