Sign inSign in
ConceptAI & ML

Markov decision process

A mathematical framework for modeling decision making in situations where outcomes are partly random and partly under the control of a decision maker.
as Emma Brunskill defines itStanford UniversityThe wording closest to all 11 definitions
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Opens up

Concepts that name this one as a prerequisite.

Lecturers

10

Each in their own terms, from the easiest level.

  • David Silver

    Google DeepMind · Introductory

    The main formalism for reinforcement learning when working with fully observable environments.
    • 51:24Introduction to Reinforcement Learning
    • 43:16Markov Processes, Reward Processes & Bellman Equations
  • Brian Yu

    Harvard University · Undergraduate

    A model for decision-making that represents states, actions, and their rewards.
    • 8:31:20Harvard CS50’s Artificial Intelligence with Python – Full University Course
  • Pieter Abbeel

    UC Berkeley · Undergraduate

    A mathematical framework for modeling decision-making in situations where outcomes are partly random and partly under the control of a decision maker.
    • 3:30Markov Decision Processes (MDPs) Part 2/2
  • Fei-Fei Li, Justin Johnson & Serena Yeung

    Stanford University · Undergraduate

    A mathematical formulation of the reinforcement learning problem that satisfies the Markov property.
    • 6:22Deep Reinforcement Learning
  • Onur Mutlu

    ETH Zürich · Graduate

    A mathematical framework for modeling decision-making where outcomes are partly random and partly under the control of a decision-maker.
    • 1:12:28Memory Controller Microarchitecture, Row Policies & Request Scheduling
  • Sergey Levine

    UC Berkeley · Graduate

    A decision process defined by states, actions, rewards, and transition probabilities on a Markovian state.
    • 4:31Policy Gradient Foundations: Trajectory Distributions & High-Dimensional State Spaces
  • Saman Amarasinghe

    MIT · Research

    A mathematical framework for modeling decision making where outcomes are partly random and partly under the control of a decision maker.
    • 14:04Compiler 2.0: Building the Next Generation of Compilers with Machine Learning
  • Max Simchowitz

    Carnegie Mellon University · Research

    A formal framework for decision-making specified by states, actions, transition probabilities, rewards, an initial state distribution, and a problem horizon.
    • 5:24Generative Control, Action Chunking, and Moravec’s Paradox
  • Eugene A. Feinberg

    Alberta Machine Intelligence Institute (Amii) · Research

    A mathematical framework for modeling decision making in situations where outcomes are partly random and partly under the control of a decision maker, defined by states, actions, transition probabilities, and costs.
    • 13:25Sequential Optimization of Dynamically Augmented Conditional Value-at-Risk

Lectures that assume it

15

The first 12 are shown.

Connections

35

The lectures that define it or assume it, and the concepts next to it.

Concepts9

Show 3 more

Lectures26

Show 20 more

10 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.