ConceptMathematics
ReLU activation function
A non-linear function applied component-wise that maps positive numbers to themselves and negative numbers to zero.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Opens up
Concepts that name this one as a prerequisite.
Lecturers
2Each in their own terms, from the easiest level.
Alan Edelman
An activation function defined as the maximum of zero and t.
Lectures that assume it
3Connections
11The lectures that define it or assume it, and the concepts next to it.