static: updated robots.txt example
marcink -
r2880:7de9fb89 default
Not Reviewed
Show More
Add another comment
TODOs: 0 unresolved 0 Resolved
COMMENTS: 0 General 0 Inline
@@ -1,8 +1,9
1 # See http://www.robotstxt.org/robotstxt.html for documentation on
1 # See http://www.robotstxt.org/robotstxt.html for documentation on
2 # how to use the robots.txt file
2 # how to use the robots.txt file
3 #
3
4 # To forbid all spiders from indexing, uncomment the next two lines:
4 User-agent: *
5 # User-Agent: *
6 # Disallow: /
7
5
8 User-Agent: *
6 # To forbid all spiders from indexing, uncomment the next line:
7 #Disallow: /
8
9
Comments 0
You need to be logged in to leave comments. Login now