Sign inSign in
ConceptPhysics

Chain rule for entropy

The entropy of a joint random variable XY is equal to the entropy of X plus the entropy of Y conditioned on X.
as Ryan O'Donnell defines itCarnegie Mellon University
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Opens up

Concepts that name this one as a prerequisite.

Lecturers

2

Each in their own terms, from the easiest level.

  • Vijay Balasubramanian

    International Centre for Theoretical Physics · Graduate

    The entropy of a joint distribution of two variables is equal to the entropy of one variable plus the conditional entropy of the other variable given the first.
    • 23:26Introduction to Information Theory

Connections

5

The lectures that define it or assume it, and the concepts next to it.

Concepts3

Lectures2

2 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.