Embeddings
A · 10-second intuition Each token id selects one learned row of numbers; that row is the token's starting point inside the model.
Predict before you read
Token 37166 and token 37167 have consecutive ids. What does that tell you about their meaning?