Webcrawl — turn any URL into clean Markdown

webcrawl converts URLs into LLM-ready Markdown with zero API keys. It handles websites and JS SPAs, PDFs and Office docs, YouTube videos (transcripts), GitHub repos, ArXiv papers, shopping/travel/real-estate listings, and CVE advisories — from one CLI (npx webcrawl) and one MCP server (@webcrawl/mcp).

Quick start (10 seconds)

# Any URL to clean Markdown (zero keys, local)
npx webcrawl scrape https://github.com/torvalds/linux

# Check engine readiness first if anything fails
npx webcrawl doctor

Use npx webcrawl setup to register the MCP server + this skill for Claude Code / Cursor / Codex / Gemini / Windsurf in one command.

Decision rules