Robots.txt Checker
Check a site's robots.txt file and what it blocks.
Enter a domain to fetch and review its robots.txt file — see what's disallowed and whether it links to a sitemap.
Check a site's robots.txt file and what it blocks.
Enter a domain to fetch and review its robots.txt file — see what's disallowed and whether it links to a sitemap.