llms.txt Explained: How to Help AI Models Understand Your Site
llms.txt is a simple Markdown file that gives AI models a clean, accurate summary of your site or product. Here is what it is, what to include, and how to create one.
Read article →How it works
- Enter a domain (for example
example.com). - The tool probes standard paths like
/sitemap.xmland reads theSitemap:line in robots.txt. - It fetches each sitemap found and parses the XML, following sitemap-index files to their child sitemaps.
- You get the discovered sitemap URLs, a validity check and a live count of the URLs inside.
What it checks
- Discovery — which common locations actually return a sitemap.
- robots.txt reference — whether the sitemap is declared for crawlers.
- Format validity — that the file is well-formed XML with the expected tags.
- Sitemap type — a normal URL set versus a sitemap index pointing to others.
- URL count — how many pages are listed across all sitemaps.
- Lastmod data — whether entries include last-modified dates.
- HTTP status — that the sitemap returns 200 and not an error or redirect.
Common use cases
- Confirming submission readiness — verify a valid sitemap exists before submitting it to Search Console.
- Spotting indexing gaps — compare the URL count to how many pages you expect.
- Debugging a broken feed — catch malformed XML or a 404 sitemap fast.
- Researching a competitor — see how many pages a rival publishes.
Example
Run the tool on a blog and you might find /sitemap.xml is actually a sitemap index that points to /post-sitemap.xml and /page-sitemap.xml, together listing 312 valid URLs — confirming the whole site is discoverable and the feed is healthy.
Frequently asked questions
Is the Sitemap Finder free?
Yes — completely free, with no signup and no limits. Check as many domains as you like.
Where should my sitemap live?
The convention is /sitemap.xml at the root, and it should be referenced in robots.txt so crawlers find it automatically. Verify that reference with the Robots.txt Tester and learn the full structure in our XML sitemaps guide.
Does having a sitemap guarantee indexing?
No. A sitemap helps Google discover pages, but each URL still has to be crawlable and worth indexing. Check page-level health with the On-Page SEO Audit to make sure listed pages aren't blocked or thin.