Does llms.txt actually work?

What llms.txt actually is, in plain English

llms.txt is a plain text file you can place at yoursite.com/llms.txt, sitting right next to your robots.txt file. It lists your site’s main pages with short, plain-language summaries, written in simple markdown rather than full web page code. The idea, first put forward by Answer.AI’s Jeremy Howard back in 2024, was straightforward: AI models reading a normal webpage have to wade through navigation menus, cookie banners, adverts and half the layout before they reach your actual content. An llms.txt file skips all that. It hands the AI a tidy, curated menu instead: here’s who we are, here’s what we do, here are the pages that matter. Think of it as a cheat sheet left out for a robot, rather than making it search a messy room to find what it needs. It costs nothing to host and takes an afternoon to write properly, and in theory it makes life easier for any AI tool that bothers to look for it. Whether anything actually looks for it yet is where things get more complicated.

Why it got hyped so fast

The moment llms.txt appeared, a chunk of the SEO world treated it like robots.txt 2.0, the next must-have file every website needs before the competition gets there first. That reaction isn’t irrational. Robots.txt genuinely did become standard practice, so a new file aimed at AI models felt like the obvious next chapter. It’s also an easy thing to sell: cheap to build, quick to install, and it gives business owners something concrete to point at when they’re anxious about AI search and unsure what, if anything, they can control. That anxiety has a real cause too: something close to 48% of Google searches now show an AI-generated answer at the top of the page, so it’s no wonder people want a lever to pull. In a landscape that otherwise feels like a black box, “just add this one file” is a comforting story. Plenty of agencies ran with it without checking whether any AI company had actually said they use it. We’d rather tell you where the story is thin than sell you certainty we don’t have.

The honest truth: nobody’s confirmed they read it

Here’s the bit most agencies won’t put in writing. As of 2026, no major AI vendor, not OpenAI, not Google, not Anthropic, not Microsoft, has publicly confirmed that their models read llms.txt files in production when answering real user questions. Adoption across the web is still low too, sitting in the low single digits even among well-optimised sites. That doesn’t mean it’s a scam or a waste of an afternoon. It means the honest answer to “does llms.txt work” is: we don’t know yet, and anyone telling you it definitely does is guessing the same as everyone else. What we do know is how these AI systems actually gather information right now, and it leans far more heavily on structured data, consistent business listings, and content that’s genuinely easy to parse, all things we cover elsewhere on this site. llms.txt sits at the speculative end of the toolkit, not the proven end. You deserve to know that before anyone charges you for it.

So should you bother with one?

Yes, but with the right expectations. Because it costs almost nothing to set up and can’t realistically hurt you, llms.txt earns its place as one small, cheap signal in a much bigger picture, not the centrepiece of your AI visibility work. Treat it the way you’d treat a spare key under the doormat: sensible to have, not something you’d bet the house on. The things that actually seem to influence how AI assistants describe and recommend a business are the boring, provable ones: your Google Business Profile, consistent name-address-phone details across the web, structured data markup, and content that answers real questions in plain sentences. Get those right first. Then, if you want to cover every base, add an llms.txt file as the finishing touch rather than the foundation. Our free llms.txt generator will build you one in minutes once the fundamentals are sorted, and our guide to GEO (search visibility for AI, as opposed to traditional Google rankings) walks through the full list of what actually moves the needle.