ConceptAI & ML
Layer normalization
A technique to normalize the inputs of a layer to have a specific mean and variance, often followed by learnable scaling and shifting parameters.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Opens up
Concepts that name this one as a prerequisite.
Lecturers
2Each in their own terms, from the easiest level.
Andrej Karpathy
A technique to normalize the activations of the features for each individual example across its embedding dimensions to have zero mean and unit variance.
Lectures that assume it
2Connections
13The lectures that define it or assume it, and the concepts next to it.