llms.txt
llm.txt is a new standard proposal for providing a clean, text-only version of your website specifically for Large Language Models (LLMs) and AI agents. It helps AI understand your site structure and content better than raw HTML.
Prerequisites
- Access to your sitemap.xml
- ChatGPT or Claude account (to generate the file)
- FTP/File Manager access to upload the file
AI Generation Workflow (Recommended)
The easiest way to create this file is to let an AI convert your existing XML sitemap.
Get Your Sitemap
Go to yoursite.com/sitemap_index.xml
Copy the list of URLs (or the XML source code).
Generate with ChatGPT
Paste your sitemap into ChatGPT/Claude.
Use this prompt: 'Convert this XML sitemap into an llm.txt file. Format it as a simple list of Markdown links: - Page Title. Group them logically if possible.'
Copy the resulting text output.
Create & Upload File
Create a new file named llm.txt on your computer.
Paste the text content.
Upload this file to your WordPress root directory (public_html) using FTP or a File Manager plugin.
Verify at yoursite.com/llm.txt.
Best Practices
Do
- Keep it simple and text-based
- Group links by category (e.g. # Blog, # Services)
- Update it when you add significant new sections
Don't
- Include admin pages or login links
- Make the file massive (focus on high-level navigation)
- Use HTML tags (keep it Markdown/Text)
Verification Checklist
- Go to yoursite.com/llm.txt and ensure it loads as plain text
- Check that it contains your most important links
- Validate that it is not blocked by robots.txt
Pro Tips
- You can also add an `/llms.txt` (plural) as a redirect to `/llm.txt` to cover both standards.
- Include a brief description of your site at the top of the file.