Labs

Six focused experiments built from the same components as the journey. Each one starts from a question, lets you change one thing, and shows the exact numbers.

1. Lab ARMSNorm versus LayerNormWhat exactly does normalization change, and what does it keep?Open the lab →
2. Lab BAttention microscopeHow do Q, K, V, the mask and softmax produce one output?Open the lab →
3. Lab CPosition and RoPEHow can rotating vectors encode where a token is?Open the lab →
4. Lab DTemperature and samplingWhat does temperature change, and what does it not?Open the lab →
5. Lab EKV cacheWhat is stored during generation, and why?Open the lab →
6. Lab FOne training stepHow does a single update change a prediction?Open the lab →