Loreto

Free tool · AI search

llms.txt generator

The llms.txt generator builds a spec-compliant llms.txt file — the emerging standard at llmstxt.org — that gives AI crawlers like GPTBot, ClaudeBot, and PerplexityBot a curated, machine-readable map of your site. Fill in your sections and links, then copy or download the result.

llms.txt preview
Copied

    

What is llms.txt and why it matters

As AI answer engines increasingly summarize the web, a page's HTML — navigation, scripts, ads — gets in the way of a model understanding what actually matters on your site. llms.txt is a proposed standard that fixes this: a single markdown file at your domain root (/llms.txt) that lists your most important pages in a clean, machine-readable format. It's to AI models what a sitemap is to search crawlers — a curated index of what to read first.

Placing it well means AI systems cite the pages you chose, with the framing you wrote, instead of guessing from raw markup. It complements robots.txt (which controls access) rather than replacing it. These crawlers already look for structured signals:

GPTBot ClaudeBot PerplexityBot Google-Extended CCBot