llms.txt is a plain Markdown file at the root of a website (yoursite.com/llms.txt) that gives AI tools a short summary of the site and links to its most useful pages. It's a proposed standard and not a ranking factor. Google doesn't use it for Search or AI Overviews, so treat it as a small optional extra that takes about ten minutes.

Below: what the file is, what it can and can't do, a four-step way to write one, and how it differs from robots.txt.

What is llms.txt?

Jeremy Howard of Answer.AI proposed llms.txt in 2024 to help large language models read websites. A normal page is full of menus, scripts and ads. A model with a limited context window does better with a short hand-written map, and that's all llms.txt is. The format is simple Markdown:

# Site name

> One-line summary of what the site is.

Optional paragraph with more context.

## Section name

- [Page title](https://example.com/page): what the reader will find there

## Optional

- [Less important page](https://example.com/other): can be skipped

Only the H1 line is required. The summary and the link sections are what make the file worth having.

Does llms.txt help SEO or AI Overviews?

No, not directly. Google says AI Overviews and AI Mode use the same crawling, indexing and quality systems as normal Search, so no special AI file is needed. Some AI assistants and coding tools do read llms.txt when someone points them at a site, mostly for documentation.

QuestionAnswer
Will it improve Google rankings?No
Will it get me into AI Overviews?No. Clear answers and good SEO do that.
Can it help AI tools that read it?Yes. It gives them a clean summary and the right links.
Is there any risk?No. It's a public text file.
Time neededAbout 10 minutes

Who should add an llms.txt file?

It's most useful when people already use AI tools to read your site:

  • Software and API products, because developers point coding assistants at the docs.
  • Service businesses that want assistants to describe their services, area and prices correctly.
  • Blogs with a few cornerstone guides worth pointing to.

If your site has five pages, skip it and spend the ten minutes on content.

How do you create llms.txt?

  1. Write one plain sentence about who you are and who you serve. No slogan.
  2. Choose 5 to 20 pages that answer real questions: services, pricing, key guides, FAQ, contact, policies.
  3. Group them under headings and add a short note after each link.
  4. Upload the file to your site root so it opens at https://yoursite.com/llms.txt.

The free llms.txt generator builds the format for you and downloads the file.

llms.txt vs robots.txt: what's the difference?

robots.txt controls which crawlers may visit which paths, so it can block bots like GPTBot. llms.txt blocks nothing; it only describes your site. If you want AI search tools to cite you, check robots.txt first and make sure their crawlers aren't blocked. The robots.txt generator has switches for each AI bot.

What matters more than llms.txt?

  • Pages that answer the question in the first paragraph.
  • Content in the HTML itself, readable without JavaScript.
  • Accurate structured data. Try the schema generator.
  • Clear author and business details that show who stands behind the page.
  • Internal links between related articles, as in our internal linking guide.

FAQs

Where should llms.txt go?

At the root of the domain, next to robots.txt: https://example.com/llms.txt.

What is llms-full.txt?

Some sites also publish llms-full.txt with the full text of their docs in one file. It's optional and mainly used for technical documentation.

Can llms.txt stop AI training on my content?

No. To ask AI companies not to crawl or train on your pages, add robots.txt rules for their user agents.