Robots.txt Tester

Fetch and parse a site’s robots.txt, list rules per user-agent and locate sitemap declarations.

Fetching live data…