ConceptAI & ML
Value function
The expected sum of future rewards starting from state st and following policy pi thereafter.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Opens up
Concepts that name this one as a prerequisite.
Lecturers
8Each in their own terms, from the easiest level.
David Silver
A function that tells us the expected total reward given policies by all players.Ian Ball
The average discounted payoff from today onward if we're in a given state, assuming players follow the strategy profile.Robert Shiller
A function representing how people subjectively value gains and losses, characterized by a concave curve for gains, a convex curve for losses, and a kink at the reference point.Fei-Fei Li, Justin Johnson & Serena Yeung
The expected cumulative reward from following a policy starting from a given state.Sergey Levine
The expected value over all actions in a given state under your current policy of the Q-value.Stephen Boyd
The optimal value of the control problem expressed as a function of the initial state z.Parham Panahi
The expected sum of future rewards when taking a certain action in a certain state.Ashia Wilson
A function that assigns a value to each score given the true label and the classifier's decision.
Lectures that assume it
32The first 12 are shown.
- Model-Free Control — ε-Greedy SARSA & Off-Policy Q-Learning
- Planning by Dynamic Programming — Policy & Value Iteration
- Value Function Approximation & Deep Q-Networks (DQN)
- Lyapunov Analysis I
- Deep Reinforcement Learning
- Reinforcement Learning Part 1/2
- Decision Transformer: Reinforcement Learning via Sequence Modeling
- Exploration and Exploitation
- Exploration of fundamental concepts in deep reinforcement learning
- The Alberta Plan for AI Research: Continual Reinforcement Learning
- Model-Free Prediction — Monte Carlo, TD(0) & TD(λ)
- Dynamic Programming I
Connections
53The lectures that define it or assume it, and the concepts next to it.
Concepts10
Show 4 moreShow fewer
Lectures43
- Introduction to Reinforcement Learning
- Markov Processes, Reward Processes & Bellman Equations
- Natural Policy Gradients, Covariant Updates & The Fisher Information Matrix
- Implicit Cartels
- Deep Reinforcement Learning
- Behavioral Finance and the Role of Psychology
Show 37 moreShow fewer
- Classic Games
- Convex Optimization II: Model Predictive Control
- Endpoint Replay: Compressing the Recency Buffer in Deep Reinforcement Learning
- Deep Reinforcement Learning
- Evaluation Design
- Model-Free Control — ε-Greedy SARSA & Off-Policy Q-Learning
- Planning by Dynamic Programming — Policy & Value Iteration
- Value Function Approximation & Deep Q-Networks (DQN)
- Lyapunov Analysis I
- Deep Reinforcement Learning
- Reinforcement Learning Part 1/2
- Decision Transformer: Reinforcement Learning via Sequence Modeling
- Exploration and Exploitation
- Exploration of fundamental concepts in deep reinforcement learning
- The Alberta Plan for AI Research: Continual Reinforcement Learning
- Model-Free Prediction — Monte Carlo, TD(0) & TD(λ)
- Dynamic Programming I
- Markov Decision Processes (MDPs) Part 2/2
- Trust Region Policy Optimization (TRPO) & Monotonic Policy Improvement
- Simulation-Driven Robot Learning for the Lazy Researcher
- Exploration of advanced topics in deep reinforcement learning
- Foundational concepts in deep reinforcement learning
- Model-Based Reinforcement Learning with Policies
- Offline Reinforcement Learning (CS 285, Lecture 15, Part 3)
- Control as Inference, Part 2
- Active Inference: Bridging Perception and Decision-Making
- Savings
- Policy Gradient Methods
- Integrating Learning and Planning
- Trajectory Stabilization
- Offline Reinforcement Learning
- Towards a Statistical Foundation for Reinforcement Learning
- RL with Sequence Models & Language Models, Part 1 (CS 285, Lecture 21)
- Reinforcement Learning Part 2/2
- Deep Inference with Karl J. Friston
- Guest Lecture: Aviral Kumar (UC Berkeley CS 285)
- Bridging Rigorous Methods with Machine Learning in Robotics