Sign inSign in
ConceptAI & ML

Neural network layer

A layer computes a linear transformation of the input vector via a weight matrix and bias vector, followed by a non-linear activation function.
as Gilbert Strang defines itMITThe wording closest to all 3 definitions
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Opens up

Concepts that name this one as a prerequisite.

Lecturers

3

Each in their own terms, from the easiest level.

  • Andrej Karpathy

    Undergraduate

    A fundamental building block of a neural network that performs matrix multiplication of inputs by weights, followed by adding a bias and applying a non-linearity.
    • 1:13:53Spelled-Out Intro to Language Modeling: Building makemore (Bigram & Cross-Entropy)
  • Chris Ré

    Stanford University · Graduate

    A neural network layer is a transformation of input data using weights and biases followed by an activation function.
    • 50:45Neural Networks I: Feedforward Architectures & Backpropagation

Lectures that assume it

12

Connections

24

The lectures that define it or assume it, and the concepts next to it.

3 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.