Show More
| @@ -1,8 +1,9 b'' | |||
|
|
1 | 1 | # See http://www.robotstxt.org/robotstxt.html for documentation on |
|
|
2 | 2 | # how to use the robots.txt file |
|
|
3 | # | |
|
|
4 | # To forbid all spiders from indexing, uncomment the next two lines: | |
|
|
5 | # User-Agent: * | |
|
|
6 | # Disallow: / | |
|
|
3 | ||
|
|
4 | User-agent: * | |
|
|
7 | 5 | |
|
|
8 | User-Agent: * | |
|
|
6 | # To forbid all spiders from indexing, uncomment the next line: | |
|
|
7 | #Disallow: / | |
|
|
8 | ||
|
|
9 | ||
General Comments 0
You need to be logged in to leave comments.
Login now