Firecrawl Markdown Capture Pipeline

Captures clean site content through Firecrawl endpoints like /v1/scrape, /v1/map, and /v1/crawl, with Markdown output for downstream agents. Great for turning messy websites into reliable research corpora, docs snapshots, or retrieval-ready source material.

Installation

Requirements and caveats from upstream:

• python
• Node.js

Basic usage or getting-started notes:

• Sign up at firecrawl.dev to get your API key. Try the playground to test it out.

• Search

• Search the web and get full content from results.

• Source: https://github.com/firecrawl/firecrawl

• Extracted from upstream docs: https://raw.githubusercontent.com/firecrawl/firecrawl/HEAD/README.md