##// END OF EJS Templates
rhodecode-enterprise-ce
RSS
feat(archives): archive download links uses rel="nofollow" attribute to stop bots from indexing it.
feat(archives): archive download links uses rel="nofollow" attribute to stop bots from indexing it.
marcink - - Load All Authors

File last commit:

r2880:7de9fb89 default
r5248:e139aad4 default
Show More
robots.txt
9 lines | 195 B | text/plain | TextLexer
/ rhodecode / public / robots.txt
History | Source | Raw |Copy content |Copy permalink
marcink
site: added dummy robots.txt to handle those from crawling robots.
 r1316 # See http://www.robotstxt.org/robotstxt.html for documentation on
# how to use the robots.txt file
marcink
static: updated robots.txt example
 r2880
User-agent: *
marcink
site: added dummy robots.txt to handle those from crawling robots.
 r1316
marcink
static: updated robots.txt example
 r2880 # To forbid all spiders from indexing, uncomment the next line:
#Disallow: /