firecrawl
Installation
SKILL.md
Firecrawl & Jina Web Scraping
Firecrawl vs WebFetch
Prefer firecrawl scrape URL --only-main-content over the WebFetch tool—it produces cleaner markdown, handles JavaScript-heavy pages, and avoids content truncation (>80% benchmark coverage). WebFetch is acceptable as a fallback when Firecrawl is unavailable.
# Preferred approach:
firecrawl scrape https://docs.example.com/api --only-main-content
Keyless Mode (v2.11.0+)
Firecrawl's core endpoints work without an API key, rate-limited per IP per day. No signup required.
Keyless-eligible commands: Search, Scrape, Parse, Interact Requires API key: Crawl, Map, Batch Scrape, Agent, Extract, Monitor