Opening Mutual Information
Mutual Information
- Length
- 28 min
- Level
- Undergraduate
- Recorded
- Carnegie Mellon University2020
Chapter 1 of 4: Definition of mutual information
Ryan O'Donnell's lecture on mutual information, from CMU 15-750: A Theorist's Toolkit, covers conditional entropy and conditional mutual information. O'Donnell bounds mutual information between zero and the smaller entropy, gives the chain rule for joint entropy, and shows conditioning can raise or lower it.
Your comment is kept while you sign up.Sign in
O'Donnell shows how conditioning can raise or lower the information two random variables share.
Ryan O'Donnell's lecture on mutual information, from CMU 15-750: A Theorist's Toolkit, covers conditional entropy and conditional mutual information. O'Donnell bounds mutual information between zero and the smaller entropy, gives the chain rule for joint entropy, and shows conditioning can raise or lower it.
This lecture
Lecture 77 of 89 of A Theorist's Toolkit.
Choose a node to see how it connects to this lecture. What comes before is on the leftat the top. What comes after is on the rightat the bottom. The ring is what it teaches. People and places are above. Other lectures and books are below.
Press a chosen node again to open it.