ConceptAI & ML
Adam optimization algorithm
An optimization algorithm that computes adaptive learning rates for each parameter by combining estimates of first and second moments of the gradients, along with bias correction terms.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Lecturers
1Connections
4The lectures that define it or assume it, and the concepts next to it.