Linear projections (xW)
A · 10-second intuition Multiplying a vector by a learned matrix re-describes it in a new set of directions, possibly of a different size.
Predict before you read
X has shape [6, 4096] and W has shape [4096, 1024]. What is the shape of XW?