Sign inSign in
ConceptAI & ML

Markov property

The property where the future state is conditionally independent of past states given the current state.
as Sergey Levine defines itUC BerkeleyThe wording closest to all 9 definitions
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Opens up

Concepts that name this one as a prerequisite.

Lecturers

6

Each in their own terms, from the easiest level.

  • David Silver

    Google DeepMind · Introductory

    A state is Markov if and only if the future is independent of the past given the present.
    • 42:25Introduction to Reinforcement Learning
    • 3:27Markov Processes, Reward Processes & Bellman Equations
  • Sergey Levine

    UC Berkeley · Undergraduate

    • 9:54Imitation Learning I: Behavioral Cloning & Distributional Shift
    • 0:25RL with Sequence Models & Language Models, Part 1 (CS 285, Lecture 21)
  • Pieter Abbeel

    UC Berkeley · Undergraduate

    The property that the future state depends only on the current state, not on the past.
    • 11:26Hidden Markov Models
  • Joe Blitzstein

    Harvard University · Undergraduate

    A conditional probability statement relating the present state to the future state, helping determine what will happen at a future time step given the current state.
  • Fei-Fei Li, Justin Johnson & Serena Yeung

    Stanford University · Undergraduate

    The property that the current state completely characterizes the state of the world.
    • 6:29Deep Reinforcement Learning
  • Alberto Abbondandolo

    Institute for Advanced Study · Graduate

    The future state of a system depends only upon the present state, not on the sequence of events that preceded it.
    • 31:53Gibbs Measures on Infinite Trees and Homoclinic Points

Lectures that assume it

7

Connections

26

The lectures that define it or assume it, and the concepts next to it.

6 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.