llms.txt

Writes llms.txt, a Markdown index at the site root with one line per page, and checks it against sitemap.xml. An agent that reads the site finds there a short list of what each page holds.

Check before use: whether the engines you target document reading llms.txt, and the current form of the proposal at <URL of the llms.txt proposal>. Treat the file as an index for agents. Promise no ranking or citation effect from it.

Inputs

• The folder the site is served from (<site root>, for example public/ or the repository root).
• sitemap.xml in that folder. Without one, the built HTML pages.
• Optional: aieo/llms-exempt.txt, one URL per line, for pages the index leaves out (legal pages, error pages, tag lists).

Steps

1. List the pages. Read the <loc> entries of sitemap.xml. Without a sitemap, list the built *.html files and say so in the report. For each page read its <title>, its meta description and its first paragraph.
2. Copy the template if the site has no llms.txt: