Fetch and analyse a domain's robots.txt, its directives and the referenced sitemaps.
Need more than a tool? Explore our Custom Development services →