ConceptMathematics
Information theory
A mathematical study of the quantification, storage, and communication of information.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Opens up
Concepts that name this one as a prerequisite.
Lecturers
5Each in their own terms, from the easiest level.
David MacKay
A field invented by Claude Shannon to solve communication problems, fundamentally addressing reliable communication over an unreliable channel.Robert Harle
The study of the quantification, storage, and communication of information.Richard Hamming
A mathematical framework for studying the transmission, processing, and utilization of information.Vijay Balasubramanian
The study of quantifying information and how much you learn from a stream of messages.
Lectures that assume it
38The first 12 are shown.
- Scaling Down the Laws of Thermodynamics
- Me and My Markov Blanket
- Dynamic Connectivity Lower Bound
- Query Cost Models: Statistics
- Persistent Data Structures
- On the Measure of Intelligence: Program Synthesis and Fluid Abstraction
- From System 1 to System 2 Deep Learning
- New Bodies, Unconventional Minds: A Continuum of Cognition and Consciousness
- Extremal Combinatorics Meets Algorithms and Data Structures
- Controlling Stochastic Biophysical Processes, from Protein Folding to Evolution
- Memory Hierarchy Models
- Succinct Structures I
Connections
50The lectures that define it or assume it, and the concepts next to it.
Concepts7
Show 1 moreShow fewer
Lectures43
- Introduction to Information Theory (University of Cambridge, Lecture 1)
- Information Theory: A Sample Lecture
- Course Overview: Applied Linear Algebra & Linear Dynamical Systems
- You and Your Research
- Introduction to Information Theory
- Scaling Down the Laws of Thermodynamics
Show 37 moreShow fewer
- Me and My Markov Blanket
- Dynamic Connectivity Lower Bound
- Query Cost Models: Statistics
- Persistent Data Structures
- On the Measure of Intelligence: Program Synthesis and Fluid Abstraction
- From System 1 to System 2 Deep Learning
- New Bodies, Unconventional Minds: A Continuum of Cognition and Consciousness
- Extremal Combinatorics Meets Algorithms and Data Structures
- Controlling Stochastic Biophysical Processes, from Protein Folding to Evolution
- Memory Hierarchy Models
- Succinct Structures I
- Quantum Darwinism and the Emergence of the Objective, Classical World
- Benchmarking and Evaluation: How Do We Know What LLMs Can Do?
- Information Complexity
- Quantum "Supremacy"
- States, Logic & Complex Vector Spaces
- The World As Hologram: Black Hole Complementarity and Hawking Radiation
- Unifying the Cognitive Sciences: The Free Energy Principle
- Active Inference: Bridging Perception and Decision-Making
- The Physics of Motivation: An Active Inference Perspective
- Key Events in Evolution
- Disturbance and Recovery Dynamics in Complex Ecological Systems
- Large Language Models and Concepts in Natural Language
- Quantum Darwinism and Classical Objectivity: A Collision Model Viewpoint
- Bayesian Information Engine that Optimally Exploits Noisy Measurements
- Gibbs Paradox in Stochastic Thermodynamics
- Optimal Finite-Time Copying Protocols
- The Meaning of Spacetime: Black Holes and Quantum Entanglement
- The Future of Physics
- Deep Inference with Karl J. Friston
- The Physics of Communication
- The Universe in a Box: Astrophysical Simulation and Supercomputing
- Exploration of advanced topics in deep reinforcement learning
- What to Learn from Few Visible Transitions' Statistics?
- Living in an Acoustic World (University of South Florida, 1974)
- Geometric Design Principle of Oscillation-driven Catalytic Molecular Machines
- The Role of TCS in Understanding (AI) Consciousness