ConceptAI & ML
Rectified linear unit
An activation function that computes the maximum of zero and the input, returning the input if positive and zero otherwise.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Opens up
Concepts that name this one as a prerequisite.
Lecturers
6Each in their own terms, from the easiest level.
Ian Goodfellow
A deep convolutional rectified linear unit net outputs a piecewise linear function of the input because it uses rectified linear units.Pieter Abbeel
An activation function that outputs the input directly if it is positive, otherwise, it outputs zero.Fei-Fei Li, Justin Johnson & Serena Yeung
An activation function computing that does not saturate in the positive region, is computationally efficient, and converges faster.Sara Beery
A non-linearity defined as the maximum of zero and the input z, widely used as a default choice in neural networks.Yann LeCun
A simple non-linearity function defined as the positive part of its argument.
Connections
12The lectures that define it or assume it, and the concepts next to it.