ConceptPhysics
Mutual information
A measure of the mutual dependence between two random variables, representing how much information is shared between the system and environmental fragments.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Opens up
Concepts that name this one as a prerequisite.
Lecturers
12Each in their own terms, from the easiest level.
Ryan O'Donnell
The sum of the entropies of two marginal distributions minus the entropy of their joint distribution.Wojciech Zurek
Sergey Levine
The KL divergence between the joint distribution over x and y and the product of their marginals.Karl Friston
The mutual information between causes (states of the world) and observed outcomes under a given policy.Vijay Balasubramanian
A measure of how much information an output variable R contains about an input variable S, computed as the total response entropy minus the noise entropy.Fionnuala Curran
A quantity defined by von Neumann entropies that measures what the system and a particular environment fraction know about each other.Steve Campbell
Mutual information captures the information you can learn about one system by interrogating another system.Bill Wootters
A quantity that measures the mutual dependence between two random variables, used here between the number of heads Bob sees and the actual value of theta.Massimiliano Esposito
The sum of the system and environment entropies minus the total entropy.Pieter Reinder Ten Wolde
Mutual information quantifies the extra free energy cost required to create correlations between two separated systems.Fernando Galve
A measure used to quantify the amount of information a given fragment in the environment has about the system.Daniel Maria Busiello
A measure of information thermodynamics used to quantify the reduction of entropy in the readout population encoding signal information.
Lectures that assume it
8- Transmission Versus Truth: What Will It Take to Make an Al as Smart as a 4-Year-Old?
- Quantum Darwinism and the Emergence of the Objective, Classical World
- Information Complexity
- Unifying the Cognitive Sciences: The Free Energy Principle
- The Physics of Motivation: An Active Inference Perspective
- Eavesdropping on the Decohering Environment: Quantum Darwinism, Amplification, and Objective Reality
- Exploration of advanced topics in deep reinforcement learning
- Exploration of advanced topics in deep reinforcement learning
Connections
32The lectures that define it or assume it, and the concepts next to it.
Concepts10
- Entropy
- Information theory
- Probability distribution
- Density matrix
- Marginal distribution
- Classical plateau
Show 4 moreShow fewer
Lectures22
- Mutual Information
- Deep Reinforcement Learning
- Quantum Information Theory
- Emergence of the Classical from within the Quantum Universe
- Active Inference: Bridging Perception and Decision-Making
- Quantum Darwinism and Classical Objectivity: A Collision Model Viewpoint
Show 16 moreShow fewer
- Why Does Nature Like the Square Root of Negative One?
- Inclusive Stochastic Thermodynamics
- Optimal Finite-Time Copying Protocols
- Helgoland 2025: Wojciech Zurek
- Introduction to Information Theory
- Quantum Darwinism and Non-Markovian Evolution
- Minimal Architecture for Adaptation in Non-Equilibrium Chemical Signaling Networks
- Can Quantum Darwinism Arise in Structured Environments?
- Transmission Versus Truth: What Will It Take to Make an Al as Smart as a 4-Year-Old?
- Quantum Darwinism and the Emergence of the Objective, Classical World
- Information Complexity
- Unifying the Cognitive Sciences: The Free Energy Principle
- The Physics of Motivation: An Active Inference Perspective
- Eavesdropping on the Decohering Environment: Quantum Darwinism, Amplification, and Objective Reality
- Exploration of advanced topics in deep reinforcement learning
- Exploration of advanced topics in deep reinforcement learning