Sign inSign in
ConceptAI & ML

KL divergence

A measure of how one probability distribution differs from a second, reference probability distribution.
as Phillip Isola defines itMITThe wording closest to all 5 definitions
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Opens up

Concepts that name this one as a prerequisite.

Lecturers

3

Each in their own terms, from the easiest level.

  • Phillip Isola

    MIT · Undergraduate

    • 34:14Generative Models: Basics
  • Sergey Levine

    UC Berkeley · Graduate

    A standard divergence measure on probability distributions that is parameter-independent.
    • 9:36Variational Inference, Part 2
    • 7:43Exploration of deep reinforcement learning architectures and algorithms
  • Ryan O'Donnell

    Carnegie Mellon University · Graduate

    A measure of the distance between two probability distributions, defined as the expected excess surprise of using one distribution over another.

Lectures that assume it

17

The first 12 are shown.

Connections

32

The lectures that define it or assume it, and the concepts next to it.

Concepts10

Show 4 more

Lectures22

Show 16 more

3 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.