ConceptAI & ML
Q-learning
A reinforcement learning method that uses a function approximator to estimate the action-value function.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Opens up
Concepts that name this one as a prerequisite.
Lecturers
5Each in their own terms, from the easiest level.
Pieter Abbeel
A model-free reinforcement learning algorithm that updates Q-value estimates using sample transitions and the max future Q-value.David Silver
An off-policy temporal-difference learning algorithm for estimating action-values without requiring importance sampling.Brian Yu
A method for learning a function Q of s comma a that estimates the value of performing action a in state s.Onur Mutlu
A reinforcement learning method where an agent stores quality values for every state-action pair to determine the best action to take.
Lectures that assume it
23The first 12 are shown.
- Value Function Approximation & Deep Q-Networks (DQN)
- Exploration and Exploitation
- Exploration of fundamental concepts in deep reinforcement learning
- Deep Reinforcement Learning
- Offline Reinforcement Learning II
- Expanding What Robots Can Learn in the Real World
- Exploration of advanced topics in deep reinforcement learning
- Model-Based Reinforcement Learning with Policies
- Offline Reinforcement Learning
- Endpoint Replay: Compressing the Recency Buffer in Deep Reinforcement Learning
- Integrating Learning and Planning
- Offline Reinforcement Learning II
Connections
39The lectures that define it or assume it, and the concepts next to it.
Concepts10
- Bellman equation
- Q-value
- Markov decision process
- Reinforcement learning
- Action-value
- Approximate Q-learning
Show 4 moreShow fewer
Lectures29
- Model-Free Control — ε-Greedy SARSA & Off-Policy Q-Learning
- Harvard CS50’s Artificial Intelligence with Python – Full University Course
- Reinforcement Learning Part 1/2
- Prefetching II, Processing-in-Memory, and Parting Thoughts (ETH Zürich: Digital Design and Computer Architecture, Lecture 25)
- Deep Reinforcement Learning
- Reinforcement Learning Part 2/2
Show 23 moreShow fewer
- Value Function Approximation & Deep Q-Networks (DQN)
- Exploration and Exploitation
- Exploration of fundamental concepts in deep reinforcement learning
- Deep Reinforcement Learning
- Offline Reinforcement Learning II
- Expanding What Robots Can Learn in the Real World
- Exploration of advanced topics in deep reinforcement learning
- Model-Based Reinforcement Learning with Policies
- Offline Reinforcement Learning
- Endpoint Replay: Compressing the Recency Buffer in Deep Reinforcement Learning
- Integrating Learning and Planning
- Offline Reinforcement Learning II
- Control as Inference, Part 5
- Towards a Statistical Foundation for Reinforcement Learning
- RL with Sequence Models & Language Models, Part 1 (CS 285, Lecture 21)
- RL with Sequence Models & Language Models, Part 3
- Challenges and Open Problems in Deep Reinforcement Learning (CS 285, Lecture 23, Part 1)
- Foundational concepts in deep reinforcement learning, likely
- Exploration of deep reinforcement learning techniques
- RL Theory
- Guest Lecture: Aviral Kumar (UC Berkeley CS 285)
- Exploration of advanced topics in deep reinforcement learning
- Advanced Topics and Course Summary