Normalization
One word, taught differently in 5 fields. Each use is given apart.
In Physics
Normalization is the total integral of the probability density over all space, which equals 1 for a physically valid state.
In Systems & CS
We normalize tables in a relational database to avoid unnecessary repetition of information.
In AI & ML
The process of adjusting a set of values so that they sum to one, restoring them to a valid probability distribution.
In Mathematics
The process of dividing a nonzero vector by its length to produce a unit vector in the same direction.
In Music & Film
The analytical process of untangling rhythmic knots and displacements to reveal the underlying voice leading.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Probability density3Integration2Database design1Encoding1Equalization1Floating point casting1Ground state1Inner product1
Opens up
Concepts that name this one as a prerequisite.
Batch normalization2Boundary conditions for wave functions1ControlSpec1Dirac delta function1Docile bodies1Dynamic regimes and tipping points1Eigenstates of the momentum operator1Expectation value of an operator1Gibbs-Boltzmann distribution1Ground state energy upper bound1Inference by enumeration1Inference for Naive Bayes1
In Physics
3Each in their own terms, from the easiest level.
Barton Zwiebach
Allan Adams
Requiring that the integral of the probability density over all space equals one.J. Michael McBride
Scaling the wave function psi so that the total integral of psi squared times volume equals one.
In Systems & CS
3Each in their own terms, from the easiest level.
Andy Pavlo
Splitting a table up into the smallest atomic units to reduce redundant information.Jimmy Lefevre
The process of standardizing character representations in Unicode text.
In AI & ML
2Each in their own terms, from the easiest level.
Andrej Karpathy
Dividing the count vector by its sum so that the elements become valid probabilities summing to one.
In Mathematics
1In Music & Film
1Lectures that assume it
25The first 12 are shown.
- Let's Build GPT: From Scratch, in Code, Spelled Out
- The Wave Function, Born's Rule & Fourier Wave Packets
- Training Neural Networks II
- Wave Packet Dynamics, Group Velocity & Dispersion
- Training Neural Networks I
- Bra-Ket Notation, Linear Operators & Physical Observables
- Quantum Harmonic Oscillators, Ladder Operators & Phase Space Dynamics
- Wave Mechanics
- Wave Mechanics (continued) and Stern-Gerlach Experiment
- Angular Momentum III: The Radial Equation, Free Particles & Spherical Potentials
- Normalizable Wavefunctions and Time Evolution (MIT 8.04 Quantum Physics I)
- Period-Finding (Simon's Algorithm over Z_N)
Connections
45The lectures that define it or assume it, and the concepts next to it.
Concepts9
- Probability density
- Integration
- Encoding
- Equalization
- Batch normalization
- Boundary conditions for wave functions
Show 3 moreShow fewer
Lectures36
- Is Probability Conserved? Hermiticity of the Hamiltonian (MIT 8.04 Quantum Physics I)
- Excited States of the Harmonic Oscillator (MIT 8.04 Quantum Physics I)
- Schenkerian Analysis 6: Displacement
- Linear Transformations in Geometry
- Expectation Values, Momentum Operator & Heisenberg Uncertainty
- Probability
Show 30 moreShow fewer
- Spelled-Out Intro to Language Modeling: Building makemore (Bigram & Cross-Entropy)
- One-Dimensional Wave Functions
- Distributed Data Warehouse OLAP Databases
- Join Algorithms
- How to Make a Text Box: A Crash Course in Unicode and OpenType
- Let's Build GPT: From Scratch, in Code, Spelled Out
- The Wave Function, Born's Rule & Fourier Wave Packets
- Training Neural Networks II
- Wave Packet Dynamics, Group Velocity & Dispersion
- Training Neural Networks I
- Bra-Ket Notation, Linear Operators & Physical Observables
- Quantum Harmonic Oscillators, Ladder Operators & Phase Space Dynamics
- Wave Mechanics
- Wave Mechanics (continued) and Stern-Gerlach Experiment
- Angular Momentum III: The Radial Equation, Free Particles & Spherical Potentials
- Normalizable Wavefunctions and Time Evolution (MIT 8.04 Quantum Physics I)
- Period-Finding (Simon's Algorithm over Z_N)
- Quantum Field Theory: Lecture 10
- Bayes' Nets: Inference (Variable Elimination)
- Complexity of Lasso with Normalized Data
- Associated Legendre Functions and Spherical Harmonics (MIT 8.04 Quantum Physics I)
- Objective-Driven AI: World Models that Learn, Remember, Reason, and Plan
- Machine Learning: Naive Bayes
- The Dirac Well and Scattering off the Finite Step
- Sieving Through Complexity: Transient Dynamics from Finite Observer-Referenced Frameworks
- Architectures: Transformers
- Hacker's Guide to Deep Learning
- Ship Reliable RAG: Evals That Grow with Your Retrieval Complexity
- GUI: Creative Audio Coding I (MUS 403, Week 11)
- Foucault: The Disappearance of the Human