Sign inSign in
ConceptAI & ML

Markov chain

A stochastic process where random variables evolve over time in a way that is one step beyond IID, representing the state of a system moving randomly from state to state.
as Joe Blitzstein defines itHarvard UniversityThe wording closest to all 9 definitions
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Opens up

Concepts that name this one as a prerequisite.

Lecturers

7

Each in their own terms, from the easiest level.

  • Joe Blitzstein

    Harvard University · Undergraduate

    • 0:08Markov Chains Continued: Irreducibility, Recurrence, Transience, and Reversibility (Statistics 110, Lecture 32)
    • 2:58A Look Ahead
  • Brian Yu

    Harvard University · Undergraduate

    A sequence of random variables where the distribution of each variable follows the Markov assumption.
    • 5:14:44Harvard CS50’s Artificial Intelligence with Python – Full University Course
  • Peter Kempthorne, Jake Xia & Vasily Strela

    MIT · Undergraduate

    A stochastic process whose effect of the past on the future is summarized only by the current state.
    • 32:55Stochastic Processes I
  • Emma Brunskill

    Stanford University · Undergraduate

    A memoryless random process consisting of a finite set of states and a transition model.
    • 1:15:27Introduction to Reinforcement Learning (CS234, 2024, Lecture 1)
  • Pieter Abbeel

    UC Berkeley · Undergraduate

    The simplest instantiation of a random variable evolving over time where a variable replicates at every time step.
    • 6:39Particle Filtering
  • Sergey Levine

    UC Berkeley · Graduate

    A mathematical system consisting of a set of states and a transition function.
    • 5:03Policy Gradient Foundations: Trajectory Distributions & High-Dimensional State Spaces
  • Stephen Boyd

    Stanford University · Graduate

    A stochastic process where a probability distribution evolves in time by being multiplied by a state transition matrix P.
    • 0:38Generalized Eigenvectors, Diagonalization, and Jordan Canonical Form

Lectures that assume it

19

The first 12 are shown.

Connections

38

The lectures that define it or assume it, and the concepts next to it.

Concepts10

Show 4 more

Lectures28

Show 22 more

7 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.