caches: make gevent curl connection cache friendly.
- gevent threads needs it's own cache, and connection
- added strict detection of cache problem in gevent curl
caches: use repo.lru based Dict cache. This LRUDict uses Timing Algo to not have to use locking
for the LRU implementation, this it's safer to use for dogpile. We used it before with beaker, so it's
generally more stable.
caches: use .refresh() instead of .invalidate()
- .invalidate() does a delete of cached valued under a key, which means
in previous logic we delete, get_or_create, and compute.
- .refresh() is simply replacing exising key with newly computed values, this
creates less locks, and it's faster.