Sign inSign in
ConceptPhysics

Shannon entropy

A measure of the uncertainty or information content associated with a probability distribution.
as Shin-Ichi Sasa defines itInternational Centre for Theoretical PhysicsThe wording closest to all 5 definitions
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Opens up

Concepts that name this one as a prerequisite.

Lecturers

5

Each in their own terms, from the easiest level.

  • Ryan O'Donnell

    Carnegie Mellon University · Undergraduate

    A numerical quantity associated with a probability distribution that measures the expected number of random coin flips needed to simulate a draw from it.
    • 0:45Quantum Information Theory
  • Ron Garret

    Google Research & TechTalks · Undergraduate

    A measure of the amount of randomness or uncertainty in a classical system A defined as the negative sum of probabilities times their logarithms.
    • 44:24The Quantum Conspiracy: Re-evaluating Popular Quantum Mechanics Interpretations
  • Chris Jarzynski

    University of Maryland · Graduate

    A measure of the uncertainty or randomness in a stream of bits, which is treated on the same level as thermodynamic Clausius entropy in information engines.
    • 1:00:09Scaling Down the Laws of Thermodynamics
  • Peter Scholze

    Max Planck Institute for Mathematics · Research

    A functional used to construct extensions of spaces of measures, defined by summing xix_i times log⁡xi\log x_i.
    • 29:36Liquid Vector Spaces and Condensed Mathematics

Lectures that assume it

2

Connections

16

The lectures that define it or assume it, and the concepts next to it.

5 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.