Exponential backoff is your friend... too few people use it.
Jittered exponential backoff. You don't want the whole herd to come back at the same time, you have to add timing jitter to the clients.
Don’t forget jitter!
alt Hacker News
Jittered exponential backoff. You don't want the whole herd to come back at the same time, you have to add timing jitter to the clients.