ConceptAI & ML
Advantage function
The difference between the Q-function and the value function, representing how much better an action is compared to the average performance of the policy in that state.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Opens up
Concepts that name this one as a prerequisite.
Lecturers
3Each in their own terms, from the easiest level.
David Silver
A function representing the difference between the action-value and state-value function, used in policy gradient updates to reduce variance.Fei-Fei Li, Justin Johnson & Serena Yeung
The difference between the Q-value of an action in a state and the value function of that state, representing how much better an action is than expected.Sergey Levine
A function measuring how much better a specific action is compared to the average action according to the policy.
Lectures that assume it
3Connections
15The lectures that define it or assume it, and the concepts next to it.