Residual connections and depth
A · 10-second intuition Adding each sub-layer's output to its input gives gradients and information a highway through 72 sub-layers.
Predict before you read
Why do residual connections help gradients?
Not started
A · 10-second intuition Adding each sub-layer's output to its input gives gradients and information a highway through 72 sub-layers.
Why do residual connections help gradients?