What is llms.txt, and does your business need one?

If you’ve read anything about AI search this year, you’ve probably seen someone recommend an llms.txt file, sometimes as if a website without one were invisible to AI. It isn’t a magic switch. It isn’t useless either. Google’s own teams have given conflicting signals about it, which hasn’t helped. This is an honest look at what llms.txt is, what it does and doesn’t do, and whether it’s worth ten minutes of your time.

What is llms.txt?

llms.txt is a plain-text file, written in Markdown, that sits at the root of your website at yoursite.com.au/llms.txt. It gives AI tools a short, curated summary of your site: who you are, what you do and links to your most useful pages, each with a one-line description. The idea is that an AI system can read one tidy file rather than crawling dozens of pages full of menus, scripts, cookie banners and design elements.

The format was proposed by Jeremy Howard in September 2024 and has been refined since. It isn’t an official web standard, and nobody is obliged to read it. It’s a convention that some tools follow and others ignore.

How is llms.txt different from robots.txt and a sitemap?

All three live at the root of your site, which causes some confusion. They do different jobs:

• robots.txt tells crawlers what they may and may not access. It’s about permission.
• sitemap.xml lists every page you want search engines to find. It’s about completeness.
• llms.txt gives a human-written summary and a short list of your best pages. It’s about context.

An llms.txt file doesn’t grant or block access to anything. If your robots.txt blocks an AI crawler, an llms.txt file won’t change that.

What does Google say about llms.txt?

This is where much of the hype falls over. Google’s guidance on AI features in Search says you don’t need new machine-readable files, AI text files or special markup to appear in AI Overviews or AI Mode. Its newer AI optimisation guide lists llms.txt among the tactics that aren’t needed for Google’s generative AI features. Google’s Search team has also said publicly that llms.txt isn’t a Google initiative.

So if you’re adding llms.txt hoping to rank higher on Google or appear in AI Overviews, it won’t do that.

The mixed signal comes from Chrome. In 2026 the Chrome team added an experimental “agentic browsing” category to Lighthouse, its website auditing tool, which includes an llms.txt check. That audit is about how well AI agents working inside a browser can understand your site, not about search rankings. As Search Engine Journal put it, Google’s guidance on llms.txt depends on which product you ask.

Why do people still use it?

Because Google Search isn’t the only thing reading the web. AI agents, coding assistants, browser assistants and some chat tools fetch pages on demand to answer a question or complete a task. For those tools, a clean, accurate summary written by you can make it easier to describe your business correctly. Adoption by the big AI chat companies is uneven and mostly unconfirmed, so it’s best treated as a low-cost extra, not a strategy.

Does your business need an llms.txt file?

Our view:

• Add one if it’s quick and cheap. On WordPress it can take minutes, and it gives AI agents an accurate summary in your own words.
• Don’t pay for it as a ranking fix. It won’t move your Google rankings, and it’s no substitute for clear content, structured data and a strong reputation.
• Keep it accurate. An out-of-date llms.txt listing old services or prices is worse than none at all, because it can spread wrong information.

How to create an llms.txt file

The structure is simple. Start with your business name as a heading, add a short summary in a quote block, then group links under headings such as Services, About and Contact. Here’s a cut-down version of what we’d write for our own site:

# Austechnova

> Sydney-based provider of website design, content, SEO, AEO & GEO,
> AI agents and managed IT support for Australian small businesses.

## Services
- [Website Design & Development](https://austechnova.com/website-design-development/): WordPress websites built to win enquiries
- [AEO & GEO](https://austechnova.com/aeo-geo/): optimisation for AI search and assistants
- [Managed IT Support](https://austechnova.com/managed-it-support/): helpdesk, monitoring and security

## Contact
- [Contact](https://austechnova.com/contact/): phone, email and enquiry form

Adding llms.txt to a WordPress site

1. Check your SEO plugin first. Several popular plugins can now generate an llms.txt file and keep it in sync as pages change.
2. Otherwise, write it by hand. Create a plain-text file called llms.txt and upload it to the root of your site, the same place robots.txt lives. Your host’s file manager or an SFTP client will do the job.
3. Keep it short. A heading, a two- or three-sentence summary, and grouped links to your most important pages with a one-line description each.
4. Check it loads. Visit yoursite.com.au/llms.txt in a browser and make sure it displays as plain text, not a 404 page.
5. Put a review in the calendar. Whenever your services, prices or contact details change, update the file too.

What to include, and what to leave out

Include the pages that best explain who you are and what you do: services, locations, pricing, about and contact, plus one or two of your most useful guides. Leave out login pages, thank-you pages, tag archives, test pages and anything private. If you wouldn’t want a stranger reading it as a summary of your business, it doesn’t belong in llms.txt.

What matters more than llms.txt

If you want AI tools to describe and recommend your business correctly, these have a far bigger impact:

1. Clear service pages that answer customer questions directly, near the top.
2. Structured data for your business, services and FAQs, consistent with what’s on the page.
3. A complete, accurate Google Business Profile and consistent directory listings.
4. A robots.txt that doesn’t accidentally block the AI crawlers you want to read your site. Many AI companies publish the names of their crawlers so you can allow or block them deliberately.
5. Genuine reviews and mentions on other trusted websites.

Those are the same foundations we cover in AEO and GEO explained, and they help your ordinary Google rankings at the same time.

Common llms.txt mistakes

• Copying your whole website into it. The point is a short, curated summary. A huge file defeats the purpose.
• Listing pages that redirect or no longer exist. Every link should go straight to a live page.
• Marketing language instead of facts. “Sydney’s leading innovative solutions provider” tells an AI nothing. “Managed IT support and web design for small businesses in Parramatta” tells it exactly what you do and where.
• Forgetting it exists. A file written once and never updated slowly drifts away from reality.
• Blocking AI crawlers in robots.txt at the same time. If you’ve told a crawler it can’t visit your site, a welcome note in llms.txt won’t help.

A five-minute llms.txt checklist

1. Your business name as the first heading.
2. Two or three plain sentences saying what you do, for whom and where.
3. Links to your main service pages, each with a one-line description.
4. Links to your about, pricing and contact pages.
5. One or two of your most useful guides or articles.
6. A note in your calendar to review it every few months.

The bottom line on llms.txt

llms.txt is a sensible, low-effort addition for most business websites, as long as it’s accurate and nobody is charging you as if it were a ranking strategy. Spend ten minutes on it, then spend the rest of your time on the things that actually move the needle: clear pages, consistent information and a reputation worth repeating. If you’re curious how AI tools see your site today, our AI search optimisation service starts with exactly that check, and if you’re thinking further ahead, our AI agents page shows what businesses are building with the same technology.

Sources: llmstxt.org: the llms.txt proposal · Google Search Central: AI features and your website · Search Engine Journal: Google’s llms.txt guidance depends on which product you ask, May 2026