Do You Need an llms.txt File for AEO? What the 2026 Data Says
llms.txt is a proposed file that summarises your site for language models. Adoption has grown fast, but log data shows almost no AI bots read it. Here is when it is worth the hour it takes.
On this page
Last updated: 30 October 2026
Quick answer: Not for visibility. Google says llms.txt is not required and will not help or hurt rankings in Search, and server log research from Ahrefs found 97% of llms.txt files received no requests at all in May 2026. It is cheap to add and may help AI agents and developer tools, but it will not get you into ChatGPT or AI Overviews. Crawlable, clear pages still do that.
llms.txt was proposed in September 2024 by Jeremy Howard of Answer.AI as a simple Markdown file at the root of a website that points language models to the most useful pages, much like a curated table of contents. It spread quickly through SEO circles, plugins added it with one click, and it is now often sold as an “AI visibility” fix. The evidence does not support that claim yet.
Key takeaways
- llms.txt is a proposal, not a standard that OpenAI, Google or Anthropic have committed to using.
- Google says the file is not required for Search and does not affect visibility or rankings.
- Adoption rose sharply, but almost no AI retrieval traffic requests the file.
- It can still be useful for documentation sites, developer tools and AI agents.
- Fix crawler access, rendering and answer-first content first.
What the file looks like
# Digital Tatva
> Answer engine optimization consultancy in Ahmedabad, India.
## Services
- [Answer Engine Optimization](https://digitaltatva.com/answer-engine-optimization/)
- [Technical AEO](https://digitaltatva.com/technical-aeo/)
## Guides
- [What is AEO?](https://digitaltatva.com/what-is-aeo/)An optional llms-full.txt version contains the full text of key pages in one file.
What the data shows in 2026
| Finding | Source |
|---|---|
| llms.txt files tracked rose from 4,088 in June 2025 to 36,120 in May 2026 | Originality.ai tracking study, reported by PPC Land, July 2026 |
| 97% of llms.txt files received zero requests in May 2026, across 137,000 domains | Ahrefs server log research, cited in the same report |
| AI retrieval bots made up about 1.1% of requests to these files | Ahrefs, same research |
| llms.txt “won’t negatively or positively impact your visibility or rankings” in Search | Google guidance, 2026 |
In short: many sites have the file, very few bots ask for it, and Google has said plainly that Search does not use it.
When it is still worth adding
- Documentation and developer products. Coding assistants and AI agents that a user points at your docs can use a clean index of pages.
- Large sites with confusing navigation. Writing the file forces you to decide which pages matter, which is useful on its own.
- When it costs nothing. If your SEO plugin generates it automatically, leaving it on does no harm.
What moves AI visibility instead
- Crawler access. Allow the search crawlers that power AI answers. See AI crawlers and robots.txt.
- Readable HTML. Make sure key content does not depend on JavaScript.
- Answer-first pages. Put a clear answer in the first two sentences. Our guide to answer-first content shows how.
- Accurate structured data. Organization, Service, Product and Article markup that matches the page.
- Outside mentions. Reviews, comparisons and press on the sites AI engines already cite.
How to add one in under an hour, if you choose to
- List your most useful pages. Services, pricing, the About page, key guides and documentation. Ten to forty links is plenty for most sites.
- Write a one paragraph summary of who you are and what you offer, in the same words as your About page.
- Group the links under short headings with a one line description each.
- Save it as llms.txt in the root of your site and check it loads at yoursite.com/llms.txt.
- Keep it in sync. If you change service names or retire pages, update the file, or it will point to things that no longer exist.
Why the hype outran the evidence
llms.txt arrived at a moment when every marketer wanted a concrete AI task to tick off. It is easy to understand, easy to generate and easy to sell. But AI search products choose sources at the moment a question is asked, using their own crawlers and indexes, and none of the major vendors has said that a site’s llms.txt decides what they cite.
That may change. If a major assistant announces support, the file becomes more useful overnight, and having a clean one ready will help. Until then, treat it as optional housekeeping. If someone tells you it is the key to appearing in ChatGPT, ask them which vendor documentation says so.
Want to know what actually holds your site back? Request an AI visibility audit.
Frequently asked questions
Does ChatGPT read llms.txt?
OpenAI has not said that ChatGPT uses llms.txt to choose sources, and log studies show very little AI retrieval traffic to these files.
Can llms.txt hurt my SEO?
Google says it will not negatively or positively affect rankings. The only risk is spending time on it instead of fixes that matter.
Is llms.txt the same as robots.txt?
No. robots.txt tells crawlers what they may fetch. llms.txt is an optional guide to your content and grants or blocks nothing.
Should agencies sell llms.txt as an AEO service?
We do not think so. It is a small, optional task, not a strategy, and should not be presented as a way to get into AI answers.
Sources
- The /llms.txt file proposal, Jeremy Howard, Answer.AI, September 2024
- llms.txt adoption rises 8.8x but 97% of files get zero AI requests, PPC Land, July 2026
- AI features and your website, Google Search Central
Product details, prices and features are checked at the time of writing and can change. Sources are linked in the text so you can check them yourself.
How does your brand appear in AI answers?
We test the questions your buyers ask across the major AI assistants and search engines, then show you what to fix first.
Get an AI Visibility Audit
