firecrawl-scraper
Convert websites into LLM-ready data with JavaScript rendering, anti-bot bypass, and autonomous agents.
- Seven core endpoints: scrape single pages, crawl entire sites, discover URLs, search the web, extract structured data, run autonomous agents, and batch process multiple URLs
- Handles JavaScript rendering, CAPTCHA/bot detection bypass, PDF/DOCX parsing, design system extraction, and content change tracking across multiple output formats (markdown, HTML, JSON, screenshots, summaries)
- Stealth mode costs 5 credits per request (as of May 2025); use auto mode (default) to charge stealth credits only if basic scraping fails
- Prevents 10 documented errors including v2.0.0 breaking changes (method renames, format changes, crawl parameter updates), job status race conditions, DNS resolution failures, and cache optimization pitfalls
Firecrawl Web Scraper Skill
Status: Production Ready Last Updated: 2026-01-20 Official Docs: https://docs.firecrawl.dev API Version: v2 SDK Versions: firecrawl-py 4.13.0+, @mendable/firecrawl-js 4.11.1+
What is Firecrawl?
Firecrawl is a Web Data API for AI that turns websites into LLM-ready markdown or structured data. It handles:
- JavaScript rendering - Executes client-side JavaScript to capture dynamic content
- Anti-bot bypass - Gets past CAPTCHA and bot detection systems
- Format conversion - Outputs as markdown, HTML, JSON, screenshots, summaries
- Document parsing - Processes PDFs, DOCX files, and images
- Autonomous agents - AI-powered web data gathering without URLs
More from jezweb/claude-skills
tailwind-v4-shadcn
|
2.7Ktanstack-query
|
2.5Kshadcn-ui
Install and configure shadcn/ui components for React projects. Guides component selection, installation order, dependency management, customisation with semantic tokens, and common UI recipes (forms, data tables, navigation, modals). Use after tailwind-theme-builder has set up the theme infrastructure, when adding components, building forms, creating data tables, or setting up navigation.
2.5Ktailwind-theme-builder
>
2.2Kfastapi
|
2.0Kcolor-palette
>
1.9K