##// END OF EJS Templates
readme: updated readme file.
readme: updated readme file.

File last commit:

r2880:7de9fb89 default
r2926:2123969c default
Show More
robots.txt
9 lines | 195 B | text/plain | TextLexer
site: added dummy robots.txt to handle those from crawling robots.
r1316 # See http://www.robotstxt.org/robotstxt.html for documentation on
# how to use the robots.txt file
static: updated robots.txt example
r2880
User-agent: *
site: added dummy robots.txt to handle those from crawling robots.
r1316
static: updated robots.txt example
r2880 # To forbid all spiders from indexing, uncomment the next line:
#Disallow: /