##// END OF EJS Templates
feat(archive-cache): added option to define a configurable top-level bucket for all shards
feat(archive-cache): added option to define a configurable top-level bucket for all shards

File last commit:

r2880:7de9fb89 default
r5445:fdcdfe77 default
Show More
robots.txt
9 lines | 195 B | text/plain | TextLexer
site: added dummy robots.txt to handle those from crawling robots.
r1316 # See http://www.robotstxt.org/robotstxt.html for documentation on
# how to use the robots.txt file
static: updated robots.txt example
r2880
User-agent: *
site: added dummy robots.txt to handle those from crawling robots.
r1316
static: updated robots.txt example
r2880 # To forbid all spiders from indexing, uncomment the next line:
#Disallow: /