1/4

UCL / DeepMind RL Lecture 4: Model-Free Prediction — Monte Carlo, TD(0) & TD(λ)

David Silver Google DeepMind

Principal Research Scientist at DeepMind & Professor at UCL

1:37:01·2015·graduate level

Contrasts unbiased high-variance Monte Carlo returns against low-variance bootstrapped Temporal-Difference learning and eligibility traces TD(λ).

AI & ML Reinforcement Learning TD Learning Monte Carlo Eligibility Traces

#Reinforcement Learning Course by David Silver# Lecture 4: Model-Free Prediction

#Slides and more info about the course: http://goo.gl/vUiyjq

Previous · Lecture 3

UCL / DeepMind RL Lecture 3: Planning by Dynamic Programming — Policy & Value Iteration

Next · Lecture 5

UCL / DeepMind RL Lecture 5: Model-Free Control — ε-Greedy SARSA & Off-Policy Q-Learning

Comments

Add a comment...Sign in

Part of course10 lectures

COMP0089: Introduction to Reinforcement Learning

Prof. David Silver

Foundational reinforcement learning course taught by AlphaGo lead researcher David Silver: Markov Decision Processes, Bellman optimality, dynamic programming, Monte Carlo, TD learning, and function approximation.

View full syllabus →

Related lectures

UCL / DeepMind RL Lecture 5: Model-Free Control — ε-Greedy SARSA & Off-Policy Q-Learning

David Silver · Google DeepMind

Next in COMP0089 · Lecture 5

UCL / DeepMind RL Lecture 6: Value Function Approximation & Deep Q-Networks (DQN)

David Silver · Google DeepMind

Shared subfield · Reinforcement Learning

UCL / DeepMind RL Lecture 2: Markov Processes, Reward Processes & Bellman Equations

David Silver · Google DeepMind

Shared subfield · Reinforcement Learning

Lecture 10: Classic Games (COMP0089)

David Silver · Google DeepMind

Shared subfield · Reinforcement Learning

UCL / DeepMind RL Lecture 1: Introduction to Reinforcement Learning

David Silver · Google DeepMind

Shared subfield · Reinforcement Learning

Lecture 9: Exploration and Exploitation (COMP0089)

David Silver · Google DeepMind

Shared subfield · Reinforcement Learning