What is llms.txt?
/llms.txt is a proposed format (llmstxt.org): a Markdown file at the root of a site that describes the site in one sentence and lists its most useful pages, to help AI assistants and agents find the right content quickly. It does not replace robots.txt or your sitemap.
To be honest: major AI providers have not confirmed that they read the llms.txt of the sites they visit. Publishing one is easy and harmless, but it is not a guaranteed lever.
Review the draft carefully
- Fix the title and the one-line description: they matter most.
- Keep the genuinely useful pages (docs, pricing, contact, key articles) and remove the rest.
- Rename the sections, which are grouped automatically by the first folder of each URL.
- Publish the file at the root, as plain text:
https://yoursite.com/llms.txt.
More free tools
Free AI visibility checker
Check for free whether ChatGPT, Claude, Perplexity and Gemini can read and cite your website - robots.txt, llms.txt, JavaScript and hidden text.
AI robots.txt generator
Build a robots.txt in one click that blocks AI training while keeping your site visible in ChatGPT Search, Claude and Perplexity. Free.
robots.txt tester for AI crawlers
Paste your robots.txt and instantly see, crawler by crawler, whether GPTBot, ClaudeBot, PerplexityBot or Google-Extended can access a page.
Verify an AI crawler IP
Check whether an IP address really belongs to OpenAI, Anthropic, Perplexity, Google, Bing, Apple or another AI company using their official IP lists.
Free prompt injection detector
Check whether a web page or a text hides instructions aimed at AI assistants - hidden text, HTML comments and invisible Unicode characters.