Momentum
Defined in one lecture.
Definitions are written by AI from each lecture’s transcript. The time opens the lecture where the lecturer explains it.
- An addition to gradient descent that biases gradient steps to continue in the direction of the previous update to gain speed and navigate loss landscapes.