Sign inSign in
ConceptAI & ML

Advantage function

The difference between the Q-function and the value function, representing how much better an action is compared to the average performance of the policy in that state.
as Sergey Levine defines itUC BerkeleyThe wording closest to all 4 definitions
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Opens up

Concepts that name this one as a prerequisite.

Lecturers

3

Each in their own terms, from the easiest level.

  • David Silver

    Google DeepMind · Undergraduate

    A function representing the difference between the action-value and state-value function, used in policy gradient updates to reduce variance.
  • Fei-Fei Li, Justin Johnson & Serena Yeung

    Stanford University · Undergraduate

    The difference between the Q-value of an action in a state and the value function of that state, representing how much better an action is than expected.
    • 44:37Deep Reinforcement Learning
  • Sergey Levine

    UC Berkeley · Graduate

    A function measuring how much better a specific action is compared to the average action according to the policy.
    • 2:07Foundational concepts in deep reinforcement learning

Lectures that assume it

3

Connections

15

The lectures that define it or assume it, and the concepts next to it.

3 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.