Robots.txt Analyzer – Fetch Robots.txt of any website


Fetch Clear Field

with or without http , https , www. All urls are accepted. Robots.txt is Usually located at the root of any domain name. For example:-http://www.example.com is the domain name and http://www.example.com/robots.txt is the location.