ConceptAI & ML
Learning rate tuning
The process of searching for an optimal learning rate by trying various values on a logarithmic scale and plotting the resulting losses.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Lecturers
2Each in their own terms, from the easiest level.
Fei-Fei Li, Justin Johnson & Serena Yeung
The process of adjusting the learning rate hyperparameter to ensure the training loss successfully decreases without exploding or stagnating.
Connections
6The lectures that define it or assume it, and the concepts next to it.