llms.txt

A short Markdown file at /llms.txt that tells AI what your business does and links to your key pages. An emerging standard. See how to write an llms.txt file.

Why it matters

An llms.txt file is a cheap way to tell AI assistants, in your own words, what your business does and where your most important pages are. It's an emerging standard, but adoption is moving quickly: in our study of 255 online stores, 49% already published one. It takes an hour or two to write, and your content team can own it.

Read the guide How to write an llms.txt file What llms.txt is, what to put in it, a complete example for an online store, and the mistakes that make it useless to AI agents. Read it

More terms in getting in

• robots.txt A file at the root of your site that tells crawlers and agents which pages they may visit.
• Bot protection Services such as Cloudflare, Akamai or DataDome that block or challenge automated visitors.
• CDN Content delivery network: the service that sits in front of your site and delivers it quickly around the world.
• CAPTCHA or challenge A test that tries to tell people from bots, such as picking out images or waiting on a “checking your browser” page.
• Rate limit A cap on how many requests a visitor can make in a given time.
• Verification Checking that a visitor claiming to be a known agent really is, using the proof its operator publishes: IP ranges, reverse DNS or a signature.

Every term, A to Z → · Read the glossary in full →