When an AI tool wants to understand your site, it has two options: crawl every page and infer what you do, or read a short file where you just tell it. llms.txt is that file. It is the simplest item in the “machine-readable web” toolkit, it takes ten minutes, and we run one ourselves at tinycommand.com/llms.txt.
What Is llms.txt?
Short answer. llms.txt is a markdown file at the root of your site (yoursite.com/llms.txt) that gives AI systems a curated map of your most important pages. Instead of forcing a model to crawl and guess, you hand it a short, structured list of what you offer and where the key pages are. The standard was proposed in 2024 at llmstxt.org.
The format is deliberately tiny: an H1 with your name, a one-line summary, then a few sections of links with a sentence of context each. That is the whole spec. Its job is curation: you decide what an AI should pay attention to, in a file a model can read in one gulp without rendering JavaScript or fighting your navigation.
llms.txt vs robots.txt vs sitemap.xml
People conflate these three because they all live at the site root. They do different jobs:
| File | llms.txt | robots.txt | sitemap.xml |
|---|---|---|---|
| Job | Curate meaning | Control access | List every URL |
| Audience | AI systems & agents | Crawlers | Search engines |
| Format | Markdown | Directives | XML |
| Says | “Read these, here's why” | “You may / may not enter” | “Every page that exists” |
A healthy site has all three. robots.txt is the bouncer, sitemap.xml is the full index, and llms.txt is the curated reading list for the AI layer on top.
What an llms.txt File Looks Like
Here is a trimmed version of a real one. Notice it is just headings and annotated links.
Does llms.txt Help SEO?
Short answer. Not directly. llms.txt is not a ranking signal, and major search engines do not rely on it. Its value is making your site easier for AI tools to understand accurately. Useful hygiene, low effort, low risk. But if you want AI citations, that is a separate discipline called answer engine optimization.
Be honest with yourself about expectations. Adding llms.txt will not bump your Google position. What it can do is help AI assistants and agents represent you correctly, and cost you almost nothing to ship. If your real aim is to get pulled into ChatGPT, Perplexity, and AI Overview answers, read our guide to answer engine optimization. That is where the real gains are.
How to Create an llms.txt File
- Create a file named exactly
llms.txt. - Add an H1 with your brand, then a one-line summary in a
>blockquote. - Add H2 sections (Products, Docs, Pricing) with markdown links and a sentence of context on each.
- Keep it short. This is a curated map, not a sitemap. Link the pages that matter.
- Save it to your site root so it serves at
yoursite.com/llms.txt.
An llms.txt tells AI about your site. A TinyAgent lets one act on it, reading your docs and data to answer and resolve requests on your behalf, 24/7. Free to start, no code.
Give an AI agent your knowledgeWhat Comes After llms.txt: OKF
llms.txt points at your pages. The next layer down carries the knowledge itself: Google’s Open Knowledge Format (OKF), a folder of linked markdown concept files an agent can act on. If llms.txt is the map, OKF is the library. You do not need both to start, but understanding how they stack shows you where the machine-readable web is heading.
Frequently Asked Questions
What is llms.txt?
llms.txt is a plain markdown file you place at the root of your site (yoursite.com/llms.txt) that gives AI systems a curated map of your most important pages. Think of it as a signpost: instead of making a model crawl and guess, you hand it a short, structured list of what you offer and where the key pages live. The standard was proposed in 2024 at llmstxt.org.
Do I actually need an llms.txt file?
It is a low-effort, low-risk nice-to-have, not a must. It will not hurt you and takes ten minutes, and AI tools that read context files get a cleaner picture of your site. But Google has said it does not use llms.txt for AI Overviews, so treat it as helpful hygiene for the wider AI ecosystem rather than a ranking lever.
What is the difference between llms.txt and robots.txt?
robots.txt tells crawlers what they are allowed to access: it is a gate. llms.txt tells AI systems what is worth reading and where to find it: it is a map. robots.txt controls access; llms.txt curates meaning. They serve different jobs, and a complete site has both, alongside a sitemap.xml for plain discovery.
Does llms.txt help SEO or AI visibility?
Indirectly at best. It is not a ranking signal, and major search engines do not depend on it. Its value is making your site easier for AI tools and agents to understand, which can help with how accurately you are represented. If your goal is being cited in AI answers, answer engine optimization is the discipline that actually moves the needle.
How do I create an llms.txt file?
Create a text file named llms.txt, start with an H1 of your brand and a one-line summary in a blockquote, then add H2 sections (Products, Docs, Pricing) with markdown links to your key pages and a short note on each. Save it to your site root so it serves at yoursite.com/llms.txt. That is the whole standard.
What is the difference between llms.txt and OKF?
llms.txt is a single file that points to your important pages. An OKF bundle is a folder of linked concept files that carries the actual knowledge. llms.txt is the map; the Open Knowledge Format is the library. They stack rather than compete, and for most websites today, a good llms.txt is the higher-impact of the two.