Webcrawl — learn any topic with cited sources

A repeatable search-then-crawl research loop: discover authoritative pages, crawl them into clean Markdown, extract claims with citations, and synthesize a digest the user can trust because every fact links to its source.

Quick start

# Discover sources for a topic
npx webcrawl search "transformer architectures survey 2026" -n 10

# Read the promising ones into Markdown
npx webcrawl scrape https://arxiv.org/abs/1706.03762
npx webcrawl map https://docs.some-framework.dev --filter architecture -n 20
npx webcrawl crawl https://docs.some-framework.dev/architecture -n 5

The research loop