ConceptAI & ML
Least squares temporal-difference
An algorithm that computes weights directly by solving for the fixed point of temporal-difference targets using least squares.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Bellman equation1Feature spaces1Linear function approximation1Linear least squares1Linear regression1Temporal difference learning1
Opens up
Concepts that name this one as a prerequisite.
Lecturers
2Each in their own terms, from the easiest level.
Sergey Levine
A formula that relates a transition matrix for a particular policy and reward vector as well as feature matrices to the corresponding weights on the value function for that policy.
Connections
6The lectures that define it or assume it, and the concepts next to it.