Sign inSign in

Entropy

One word, taught differently in 2 fields. Each use is given apart.

In Physics

The negative expected value of the log probability of a distribution, serving as a measure of how random or spread out a random variable is.
as Sergey Levine defines itUC BerkeleyThe wording closest to all 21 definitions

In Art & Architecture

A concept from physics representing the state of heat death and loss of organization, used to explain the bleak and decaying nature of contemporary existence and art.
as Kirk Varnedoe defines itNational Gallery of Art

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Opens up

Concepts that name this one as a prerequisite.

In Physics

17

Each in their own terms, from the easiest level.

  • Asimina Arvanitaki

    Perimeter Institute · Introductory

    A quantity that tells you how much disorder there is in a gas of particles.
    • 17:36Curiosity and the Cosmos: CBC IDEAS at Perimeter Institute
  • David Goodstein

    Caltech · Undergraduate

    The conserved quantity in an ideal engine defined as the ratio of the energy or heat in to the temperature at which it goes in.
    • 26:22Engine of Nature: The Carnot Engine, Part One
    • 14:29Entropy: The Carnot Engine and the Flow of Time (The Mechanical Universe, Episode 47)
  • Ramamurti Shankar

    Yale University · Undergraduate

    A state variable defined as the change in heat added divided by the temperature in a reversible process.
    • 51:17The Second Law of Thermodynamics and Carnot's Engine
    • 19:22The Second Law of Thermodynamics and Entropy
  • Sean Carroll

    Caltech · Undergraduate

    A measure of how messy or disorderly things are.
    • 14:36The Origin of the Universe and the Arrow of Time
  • Alan Guth

    MIT · Undergraduate

    A measure of the number of microscopic quantum states that contribute to a given macroscopic state.
    • 7:13Black-Body Radiation and the Early History of the Universe, Part III
  • Leonard Susskind

    Perimeter Institute · Undergraduate

    Information that is hidden, typically because it is stored in too many degrees of freedom to keep track of.
    • 18:38The World As Hologram: Black Hole Complementarity and Hawking Radiation
  • Pieter Abbeel

    UC Berkeley · Undergraduate

    A measure of uncertainty or expected code length in a probability distribution, calculated as the negative sum of pilog⁡2pip_i \log_2 p_i.
    • 1:04:20Machine Learning: Neural Networks and Decision Trees
  • Catherine Drennan

    MIT · Undergraduate

    A measure of the disorder of a system.
    • 12:02Thermodynamics: Gibbs Free Energy and Entropy
  • Joia Mukherjee

    MIT · Undergraduate

    The only state of the universe that is sustainable without inputting energy is entropy or chaos.
    • 49:47Translational Research and Advocacy
  • Ahern's Biochemistry #1 - Aqueous Solutions / pH

    Oregon State University · Undergraduate

    Disorder or chaos in a system, described here as mixed-upedness.
    • 22:23Ahern's Biochemistry #1 - Aqueous Solutions / pH
  • James Mickens

    MIT · Undergraduate

    A measure of the randomness or unpredictability of a password, which determines its resistance to guessing.
  • Robert Harle

    University of Cambridge · Undergraduate

    The expected amount of information you would get from a system, defined as the sum over different options of the probability multiplied by the log of one over the probability.
    • 30:45Information Theory: A Sample Lecture
  • Sergey Levine

    UC Berkeley · Graduate

    The negative expected value of the log probability of x, quantifying how broad a distribution is.
    • 6:14Deep Reinforcement Learning
  • Karl Friston

    University College London · Graduate

    The average surprise or self-information in thermodynamics and physics.
    • 24:18Me and My Markov Blanket
    • 16:32Unifying the Cognitive Sciences: The Free Energy Principle
  • Vijay Balasubramanian

    International Centre for Theoretical Physics · Graduate

    The average surprise associated with a probability distribution, defined as the expected value of the negative logarithm of the probabilities of the symbols.
    • 8:18Introduction to Information Theory
  • Erik Demaine

    MIT · Graduate

    A probabilistic quantity defined as the sum of probabilities times the log of probabilities, used to formalize uncertainty and information transmission.
  • Ryan O'Donnell

    Carnegie Mellon University · Graduate

    The amount of randomness in a random variable, measured in bits.

In Art & Architecture

1

    Lectures that assume it

    75

    The first 12 are shown.

    Connections

    107

    The lectures that define it or assume it, and the concepts next to it.

    Concepts10

    Show 4 more

    Lectures97

    Show 91 more

    18 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.