tavily crawl

Crawl a website and extract content from multiple pages. Supports saving each page as a local markdown file.

Prerequisites

Requires the Tavily CLI. See tavily-cli for install and auth setup.

Quick install: curl -fsSL https://cli.tavily.com/install.sh | bash && tvly login

When to use

• You need content from many pages on a site (e.g., all /docs/)
• You want to download documentation for offline use
• Step 4 in the workflow: search → extract → map → crawl → research

Quick start