Sign inSign in
ConceptPhysics

Mutual information

A measure of the mutual dependence between two random variables, representing how much information is shared between the system and environmental fragments.
as Wojciech Zurek defines itLos Alamos National LaboratoryThe wording closest to all 14 definitions
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Opens up

Concepts that name this one as a prerequisite.

Lecturers

12

Each in their own terms, from the easiest level.

  • Ryan O'Donnell

    Carnegie Mellon University · Undergraduate

    The sum of the entropies of two marginal distributions minus the entropy of their joint distribution.
    • 1:18Mutual Information
    • 31:55Quantum Information Theory
  • Wojciech Zurek

    Los Alamos National Laboratory · Graduate

    • 11:13Helgoland 2025: Wojciech Zurek
  • Sergey Levine

    UC Berkeley · Graduate

    The KL divergence between the joint distribution over x and y and the product of their marginals.
    • 7:14Deep Reinforcement Learning
  • Karl Friston

    University College London · Graduate

    The mutual information between causes (states of the world) and observed outcomes under a given policy.
    • 20:14Active Inference: Bridging Perception and Decision-Making
  • Vijay Balasubramanian

    International Centre for Theoretical Physics · Graduate

    A measure of how much information an output variable R contains about an input variable S, computed as the total response entropy minus the noise entropy.
    • 35:00Introduction to Information Theory
  • Fionnuala Curran

    Jagiellonian Quantum Information Team · Graduate

    A quantity defined by von Neumann entropies that measures what the system and a particular environment fraction know about each other.
    • 8:43Can Quantum Darwinism Arise in Structured Environments?
  • Steve Campbell

    University College Dublin · Research

    Mutual information captures the information you can learn about one system by interrogating another system.
    • 5:31Quantum Darwinism and Classical Objectivity: A Collision Model Viewpoint
  • Bill Wootters

    Williams College · Research

    A quantity that measures the mutual dependence between two random variables, used here between the number of heads Bob sees and the actual value of theta.
    • 11:18Why Does Nature Like the Square Root of Negative One?
  • Massimiliano Esposito

    International Centre for Theoretical Physics · Research

    The sum of the system and environment entropies minus the total entropy.
    • 12:40Inclusive Stochastic Thermodynamics
  • Pieter Reinder Ten Wolde

    International Centre for Theoretical Physics · Research

    Mutual information quantifies the extra free energy cost required to create correlations between two separated systems.
    • 9:39Optimal Finite-Time Copying Protocols
  • Fernando Galve

    IFISC (UIB-CSIC) · Research

    A measure used to quantify the amount of information a given fragment in the environment has about the system.
    • 11:45Quantum Darwinism and Non-Markovian Evolution
  • Daniel Maria Busiello

    International Centre for Theoretical Physics · Research

    A measure of information thermodynamics used to quantify the reduction of entropy in the readout population encoding signal information.
    • 12:36Minimal Architecture for Adaptation in Non-Equilibrium Chemical Signaling Networks

Lectures that assume it

8

Connections

32

The lectures that define it or assume it, and the concepts next to it.

Concepts10

Show 4 more

Lectures22

Show 16 more

12 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.