Activation Function

Definitions are written by AI from each lecture’s transcript. The time opens the lecture where the lecturer explains it.

• An activation function is a squashing function applied to the neuron's cell body output to introduce non-linearity.

  54:17Spelled-Out Intro to Neural Networks & Backpropagation: Building microgradAndrej Karpathy · Independent / Eureka Labs