##// END OF EJS Templates
svn: split generate and write parts for easier usage in automation scripts.
svn: split generate and write parts for easier usage in automation scripts.

File last commit:

r2880:7de9fb89 default
r3223:95dfd17a default
Show More
robots.txt
9 lines | 195 B | text/plain | TextLexer
site: added dummy robots.txt to handle those from crawling robots.
r1316 # See http://www.robotstxt.org/robotstxt.html for documentation on
# how to use the robots.txt file
static: updated robots.txt example
r2880
User-agent: *
site: added dummy robots.txt to handle those from crawling robots.
r1316
static: updated robots.txt example
r2880 # To forbid all spiders from indexing, uncomment the next line:
#Disallow: /