ConceptPhysics
Shannon entropy
A measure of the uncertainty or information content associated with a probability distribution.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Logarithm2Probability2Entropy1Information theory1Local linearity1Measures1Probability distribution1Probability theory1
Opens up
Concepts that name this one as a prerequisite.
Lecturers
5Each in their own terms, from the easiest level.
Ryan O'Donnell
A numerical quantity associated with a probability distribution that measures the expected number of random coin flips needed to simulate a draw from it.Ron Garret
A measure of the amount of randomness or uncertainty in a classical system A defined as the negative sum of probabilities times their logarithms.Chris Jarzynski
A measure of the uncertainty or randomness in a stream of bits, which is treated on the same level as thermodynamic Clausius entropy in information engines.Peter Scholze
A functional used to construct extensions of spaces of measures, defined by summing times .
Lectures that assume it
2Connections
16The lectures that define it or assume it, and the concepts next to it.
Concepts9
Show 3 moreShow fewer
Lectures7
- Scaling Down the Laws of Thermodynamics
- Quantum Information Theory
- Liquid Vector Spaces and Condensed Mathematics
- Gibbs Paradox in Stochastic Thermodynamics
- The Quantum Conspiracy: Re-evaluating Popular Quantum Mechanics Interpretations
- Analysis of Boolean Functions: Open Problems