AI & ML · Book
Reinforcement Learning: An Introduction
Sutton and Barto treat reinforcement learning as an agent maximizing reward in an uncertain environment, centre the book on core online learning algorithms, and set heavier mathematics in shaded boxes.
Read alongside
Named in lectures
Markov Processes, Reward Processes & Bellman Equations · David Silver · DeepMind COMP0089
Sutton and Barto, cited for updated notation
Planning by Dynamic Programming — Policy & Value Iteration · David Silver · DeepMind COMP0089
Sutton and Barto, cited for Jack's Car Rental example
Model-Free Prediction — Monte Carlo, TD(0) & TD(λ) · David Silver · DeepMind COMP0089
Sutton and Barto, cited for the Driving Home example
Concepts
Good fit if
Turing Laureate Richard Sutton and Andrew Barto's standard textbook assigned in both David Silver's DeepMind course and Sergey Levine's Berkeley CS285.
About the book
Part I stays within the tabular case, covering methods such as UCB, Expected Sarsa and Double Learning. Part II extends these ideas to function approximation, neural networks, the Fourier basis, off-policy learning and policy-gradient methods. Part III relates the field to psychology and neuroscience, works through case studies including AlphaGo, Atari game playing and IBM Watson's wagering, and closes on societal impacts.
Authors
Readers
Where next


Connections
15Its authors, the courses that use it and the lectures that cite it.
Scholars2
Books4
Lectures7
- Markov Processes, Reward Processes & Bellman Equations
- Planning by Dynamic Programming — Policy & Value Iteration
- Model-Free Prediction — Monte Carlo, TD(0) & TD(λ)
- Prefetching II, Processing-in-Memory, and Parting Thoughts (ETH Zürich: Digital Design and Computer Architecture, Lecture 25)
- Memory Controller Microarchitecture, Row Policies & Request Scheduling
- Online Hyperparameter Tuning as an Empirical Approach for Reinforcement Learning
