aeo-ready
Installation
SKILL.md
Google crawls pages and ranks them. AI engines synthesize answers from sources they've already ingested. Getting cited is a different problem: structure, authority, access, and content that directly answers questions.
This skill audits and fixes all four.
The Mechanics
Three types of AI crawlers exist. Know the difference before touching robots.txt:
- Training crawlers (GPTBot, ClaudeBot, CCBot) — index content once for model training datasets. Blocking them means future model versions won't know about you.
- Retrieval crawlers (PerplexityBot, OAI-SearchBot) — fetch pages in real time to answer specific user queries. Blocking these has immediate effect — your pages stop appearing in answers within hours.
- Live browsing agents (ChatGPT-User) — fetch a single page on demand when a user asks the model to visit a URL.
Phase 1: Scan the Codebase
Read the project before generating anything: