docs-crawler

Crawl a documentation website into a single Markdown corpus that an LLM can consume as context.

When to use

The user wants to capture a multi-page documentation, design-system, or reference site as Markdown — to feed an LLM, archive it, or research a design system. This skill is also invoked by the design-md skill's research phase.

Inputs

• Site URL (required) — the documentation site, e.g. https://socarframe.socar.kr/. Any page on the site works; page discovery starts from the site's sitemap.xml.
• Output directory (optional) — where to write the corpus. Defaults to ./{host}-docs/ in the current working directory.