Interactive Explainer
How Attention Works
Every word asks:
“What else should I be paying attention to?”
Q
Query
The word asking the question
K
Keys
Every other word offering an answer
V
Values
The meaning that gets passed forward
↺ Resume