##// END OF EJS Templates
manifest: include missing robots.txt file
manifest: include missing robots.txt file

File last commit:

r1316:035ac27f default
r2879:4113b953 default
Show More
robots.txt
8 lines | 216 B | text/plain | TextLexer
site: added dummy robots.txt to handle those from crawling robots.
r1316 # See http://www.robotstxt.org/robotstxt.html for documentation on
# how to use the robots.txt file
#
# To forbid all spiders from indexing, uncomment the next two lines:
# User-Agent: *
# Disallow: /
User-Agent: *