Softmax and decoding
A · 10-second intuition Decoding is the policy that turns a probability distribution into one chosen token, repeated until the answer ends.
Predict before you read
Lowering temperature from 1.0 to 0.25 does what to the top token's probability?