Robots.txt Generator Tool

The Robots.txt Generator tool generates for you a robots.txt file which will allow you to hide files or directories that you don not want to be spidered by the search engines. This tool will generate a basic file for you which you can then make the necessary changes to if you feel the need to go a little more advanced. However, the basic robots.txt file will do the job just fine.

After generating your robots.txt file, simply copy the text generated for you by the Robots.txt Generator tool and paste it into a new file called robots.txt. Upload the robots.txt file into the root directory of your website and you're done.

What Robots to disallow:
All Robots
Selected Robot (please specifiy robot below)
Directories/files to exlude:
(E.g: /includes/ or includes.html)
One per line.
 

SEO Tools

Web Design Tools

Web Utilities

Domain Tools

  • line
  • line