##// END OF EJS Templates
static: updated robots.txt example
marcink -
r2880:7de9fb89 default
parent child Browse files
Show More
@@ -1,8 +1,9 b''
1 1 # See http://www.robotstxt.org/robotstxt.html for documentation on
2 2 # how to use the robots.txt file
3 #
4 # To forbid all spiders from indexing, uncomment the next two lines:
5 # User-Agent: *
3
4 User-agent: *
5
6 # To forbid all spiders from indexing, uncomment the next line:
6 7 # Disallow: /
7 8
8 User-Agent: *
9
General Comments 0
You need to be logged in to leave comments. Login now