1/4

UCL / DeepMind RL Lecture 5: Model-Free Control — ε-Greedy SARSA & Off-Policy Q-Learning

David Silver Google DeepMind

Principal Research Scientist at DeepMind & Professor at UCL

1:36:30·2015·graduate level

Derives GLIE convergence for on-policy SARSA, importance sampling, and Watkin's off-policy Q-Learning algorithm.

AI & ML Reinforcement Learning Algorithms & Data Structures Q-Learning SARSA

#Reinforcement Learning Course by David Silver# Lecture 5: Model Free Control

#Slides and more info about the course: http://goo.gl/vUiyjq

Previous · Lecture 4

UCL / DeepMind RL Lecture 4: Model-Free Prediction — Monte Carlo, TD(0) & TD(λ)

Next · Lecture 6

UCL / DeepMind RL Lecture 6: Value Function Approximation & Deep Q-Networks (DQN)

Comments

Add a comment...Sign in

Part of course10 lectures

COMP0089: Introduction to Reinforcement Learning

Prof. David Silver

Foundational reinforcement learning course taught by AlphaGo lead researcher David Silver: Markov Decision Processes, Bellman optimality, dynamic programming, Monte Carlo, TD learning, and function approximation.

View full syllabus →

Related lectures

UCL / DeepMind RL Lecture 6: Value Function Approximation & Deep Q-Networks (DQN)

David Silver · Google DeepMind

Next in COMP0089 · Lecture 6

Lecture 9: Exploration and Exploitation (COMP0089)

David Silver · Google DeepMind

Shared subfield · Algorithms & Data Structures & Reinforcement Learning

UCL / DeepMind RL Lecture 3: Planning by Dynamic Programming — Policy & Value Iteration

David Silver · Google DeepMind

Shared subfield · Algorithms & Data Structures & Reinforcement Learning

Lecture 5, Part 1 (CS 285)

Sergey Levine · UC Berkeley

Shared subfield · Algorithms & Data Structures & Reinforcement Learning

Sequential Optimization of Dynamically Augmented Conditional Value-at-Risk

Alberta Machine Intelligence Institute (Amii)

Shared subfield · Reinforcement Learning & Algorithms & Data Structures

POPRi: Private Federated Learning using Preference-Optimized Synthetic Data

Charlie Hou · Google Research & TechTalks

Shared subfield · Algorithms & Data Structures & Reinforcement Learning