Queries, keys and values
A · 10-second intuition Each position asks a question (query), advertises what it contains (key), and offers content to copy (value).
Predict before you read
Which of Q, K, V is copied into the output?
A · 10-second intuition Each position asks a question (query), advertises what it contains (key), and offers content to copy (value).
Which of Q, K, V is copied into the output?