# See http://www.robotstxt.org/robotstxt.html for documentation on # how to use the robots.txt file # # To forbid all spiders from indexing, uncomment the next two lines: # User-Agent: * # Disallow: / User-Agent: *