1/4

UCL / DeepMind RL Lecture 2: Markov Processes, Reward Processes & Bellman Equations

David Silver Google DeepMind

Principal Research Scientist at DeepMind & Professor at UCL

1:42:04·2015·graduate level

Builds the mathematical bedrock of RL step-by-step from Markov chains to MDPs, Bellman expectation equations, and nonlinear Bellman optimality equations.

AI & ML Reinforcement Learning Probability & Information Theory MDPs Bellman Equations

#Reinforcement Learning Course by David Silver# Lecture 2: Markov Decision Process

#Slides and more info about the course: http://goo.gl/vUiyjq

Previous · Lecture 1

UCL / DeepMind RL Lecture 1: Introduction to Reinforcement Learning

Next · Lecture 3

UCL / DeepMind RL Lecture 3: Planning by Dynamic Programming — Policy & Value Iteration

Seminar notes & discussion

Sign in to comment

No public seminar notes on this lecture yet.

Part of course10 lectures

COMP0089: Introduction to Reinforcement Learning

Prof. David Silver

Foundational reinforcement learning course taught by AlphaGo lead researcher David Silver: Markov Decision Processes, Bellman optimality, dynamic programming, Monte Carlo, TD learning, and function approximation.

View full syllabus →

Related lectures

UCL / DeepMind RL Lecture 3: Planning by Dynamic Programming — Policy & Value Iteration

David Silver · Google DeepMind

Next in COMP0089 · Lecture 3

UCL / DeepMind RL Lecture 5: Model-Free Control — ε-Greedy SARSA & Off-Policy Q-Learning

David Silver · Google DeepMind

Shared subfield · Reinforcement Learning

UCL / DeepMind RL Lecture 4: Model-Free Prediction — Monte Carlo, TD(0) & TD(λ)

David Silver · Google DeepMind

Shared subfield · Reinforcement Learning

UCL / DeepMind RL Lecture 6: Value Function Approximation & Deep Q-Networks (DQN)

David Silver · Google DeepMind

Shared subfield · Reinforcement Learning

Sequential Optimization of Dynamically Augmented Conditional Value-at-Risk

Alberta Machine Intelligence Institute (Amii)

Shared subfield · Reinforcement Learning & Probability & Information Theory

UCL / DeepMind RL Lecture 1: Introduction to Reinforcement Learning

David Silver · Google DeepMind

Shared subfield · Reinforcement Learning