Free tool
robots.txt & llms.txt Generator
Generate a robots.txt and llms.txt that let AI search engines (ChatGPT, Perplexity, Claude) find and cite you — with the AI-crawler presets built in. Runs in your browser.
robots.txt
User-agent: * Allow: / Disallow: /api/ Disallow: /admin/ # AI search crawlers — allowed so you can be cited User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Google-Extended Allow: / Sitemap: https://example.com/sitemap.xml
Save as /robots.txt at your site root.
llms.txt
# Acme Co. > What you do, for whom, in one or two sentences. ## Key pages - Home: https://example.com/ - Contact: https://example.com/contact
Save as /llms.txt at your site root.
Want this done for you?
Not sure if AI engines can read your site? Book a free strategy call and I’ll review your site and show you the highest-impact fixes.
Book a free strategy call