Robots.txt analysis

Enter the name of your website and click "Download robots.txt from site".

To find out if our robot will visit the pages given in the "URL list" window, click "Check".

By editing the rules you can create a robots.txt file that's suited to your website. Please remember, that by simply doing this the file on your website will not change. You will need to manually upload the updated file to your website for the changes to take effect.