##// END OF EJS Templates
u » pc » rhodecode-enterprise-ce-fork-pc
RSS

Fork of rhodecode-enterprise-ce

http-backend: catch errors from HTTP calls that are not raising exceptions, but...
http-backend: catch errors from HTTP calls that are not raising exceptions, but return non 200 exception codes.
marcink - - Load All Authors

File last commit:

r1316:035ac27f default
r1410:a4133cfc default
Show More
robots.txt
8 lines | 216 B | text/plain | TextLexer
/ rhodecode / public / robots.txt
History | Source | Raw |Copy content |Copy permalink
marcink
site: added dummy robots.txt to handle those from crawling robots.
 r1316 # See http://www.robotstxt.org/robotstxt.html for documentation on
# how to use the robots.txt file
#
# To forbid all spiders from indexing, uncomment the next two lines:
# User-Agent: *
# Disallow: /
User-Agent: *