firecrawl-scraper

Installation
Summary

Convert websites into LLM-ready data with JavaScript rendering, anti-bot bypass, and autonomous agents.

  • Seven core endpoints: scrape single pages, crawl entire sites, discover URLs, search the web, extract structured data, run autonomous agents, and batch process multiple URLs
  • Handles JavaScript rendering, CAPTCHA/bot detection bypass, PDF/DOCX parsing, design system extraction, and content change tracking across multiple output formats (markdown, HTML, JSON, screenshots, summaries)
  • Stealth mode costs 5 credits per request (as of May 2025); use auto mode (default) to charge stealth credits only if basic scraping fails
  • Prevents 10 documented errors including v2.0.0 breaking changes (method renames, format changes, crawl parameter updates), job status race conditions, DNS resolution failures, and cache optimization pitfalls
SKILL.md

Firecrawl Web Scraper Skill

Status: Production Ready Last Updated: 2026-01-20 Official Docs: https://docs.firecrawl.dev API Version: v2 SDK Versions: firecrawl-py 4.13.0+, @mendable/firecrawl-js 4.11.1+


What is Firecrawl?

Firecrawl is a Web Data API for AI that turns websites into LLM-ready markdown or structured data. It handles:

  • JavaScript rendering - Executes client-side JavaScript to capture dynamic content
  • Anti-bot bypass - Gets past CAPTCHA and bot detection systems
  • Format conversion - Outputs as markdown, HTML, JSON, screenshots, summaries
  • Document parsing - Processes PDFs, DOCX files, and images
  • Autonomous agents - AI-powered web data gathering without URLs
Related skills
Installs
527
GitHub Stars
776
First Seen
Jan 20, 2026