##// END OF EJS Templates
dependencies: bumped psutil to 5.6.3
dependencies: bumped psutil to 5.6.3

File last commit:

r2880:7de9fb89 default
r3917:38a8f087 default
Show More
robots.txt
9 lines | 195 B | text/plain | TextLexer
site: added dummy robots.txt to handle those from crawling robots.
r1316 # See http://www.robotstxt.org/robotstxt.html for documentation on
# how to use the robots.txt file
static: updated robots.txt example
r2880
User-agent: *
site: added dummy robots.txt to handle those from crawling robots.
r1316
static: updated robots.txt example
r2880 # To forbid all spiders from indexing, uncomment the next line:
#Disallow: /