##// END OF EJS Templates
utils: by default use OS implemented pick port which is WAAAY faster, leave fallback if we need specific range.
utils: by default use OS implemented pick port which is WAAAY faster, leave fallback if we need specific range.

File last commit:

r2880:7de9fb89 default
r4883:58394708 default
Show More
robots.txt
9 lines | 195 B | text/plain | TextLexer
site: added dummy robots.txt to handle those from crawling robots.
r1316 # See http://www.robotstxt.org/robotstxt.html for documentation on
# how to use the robots.txt file
static: updated robots.txt example
r2880
User-agent: *
site: added dummy robots.txt to handle those from crawling robots.
r1316
static: updated robots.txt example
r2880 # To forbid all spiders from indexing, uncomment the next line:
#Disallow: /