What is llms.txt?
- llms.txt
- llms.txt is a proposed convention for a markdown file published at the root of a domain that lists the pages an AI assistant should read and describes what the site is. It aims to do for language models roughly what robots.txt does for crawlers: state intent directly rather than leaving it to be inferred from navigation.
01 In practice
Adoption is partial and no engine guarantees it will be read, so publishing one is a low-cost bet rather than a requirement. The asymmetry favours doing it: one file, edited occasionally, against the chance that a model uses it to find the pages you would actually want quoted.
The value is in curation. A file that mirrors the whole sitemap tells a model nothing the sitemap did not, so a useful llms.txt is shorter than the site and reflects a judgement about which pages matter.
02 Related terms
The terms next to this one.
See where you stand
Can the assistants read your site?
The free checker fetches your site the way ChatGPT, Claude and Perplexity do, and scores what comes back across twenty-three checks.