Now, copy and paste this text into a blank text file called "robots.txt" (don't forget the "s" on the end of "robots") and put it in your root directory. Like all other files on your server, make sure its permissions are set so that visitors (such as search engines) can read it. This Generator is Copyright © 2004-2008 Ian McAnerin & McAnerin Networks Inc. Introduction to Robots.txt The robots.txt
{{#tags}}- {{label}}
{{/tags}}