Read URL

Work down this fallback ladder in order. Each step is only tried when prior steps don't apply or fail.

Fallback ladder

1. Raw .md / .txt / plain-text URL → curl -sL <url> (already clean, no HTML to strip)
2. Known site → use the dedicated CLI/API from the routing table below
3. Docs page → try curl -sL <url>.md. Mintlify and other docs platforms serve clean markdown on the .md route — if the response is text/markdown, you're done; otherwise fall through
4. Blog / newsletter / multi-post index → try RSS first: curl -sL <url>/feed (also /rss, /feed.xml, /atom.xml, /index.xml). Most static-site generators and CMS platforms expose one; RSS gives you clean <content:encoded> or <summary> bodies without chrome
5. Generic site (articles, docs, tech blogs, unknown) → npx defuddle parse <url> --markdown — see references/defuddle.md
6. JS-rendered page (defuddle returns empty / skeleton-only content) → $agent-browser skill
7. Cloudflare / anti-bot protection (Turnstile, blocked responses, 403/503) → $scrapling skill
8. Still blocked and genuinely need this page → ask the user to open it and paste the content, or offer the $chrome-cdp skill (requires explicit user approval first). Otherwise, give up and report the failure.

Routing table

Step 2 — URLs matching a known domain: