Show More
| @@ -1,8 +1,9 b'' | |||||
| 1 | # See http://www.robotstxt.org/robotstxt.html for documentation on |
|
1 | # See http://www.robotstxt.org/robotstxt.html for documentation on | |
| 2 | # how to use the robots.txt file |
|
2 | # how to use the robots.txt file | |
| 3 | # |
|
3 | ||
| 4 | # To forbid all spiders from indexing, uncomment the next two lines: |
|
4 | User-agent: * | |
| 5 | # User-Agent: * |
|
|||
| 6 | # Disallow: / |
|
|||
| 7 |
|
5 | |||
| 8 | User-Agent: * |
|
6 | # To forbid all spiders from indexing, uncomment the next line: | |
|
|
7 | #Disallow: / | |||
|
|
8 | ||||
|
|
9 | ||||
General Comments 0
You need to be logged in to leave comments.
Login now