Sign inSign in
ConceptAI & ML

Imitation learning

Learning a policy or reward function from expert demonstrations.
as Dorsa Sadigh defines itUC BerkeleyThe wording closest to all 7 definitions
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Supervised learning5Machine learning2Behavioral cloning1Expert trajectories1Policy1Reinforcement learning basics1Robotics1

Opens up

Concepts that name this one as a prerequisite.

Lecturers

6

Each in their own terms, from the easiest level.

  • Emma Brunskill

    Stanford University · Undergraduate

    A technique that reduces reinforcement learning to supervised learning by assuming access to input demonstrations of good policies.
    • 23:57Introduction to Reinforcement Learning (CS234, 2024, Lecture 1)
  • Russ Tedrake

    MIT · Graduate

    Learning strategy where a robot is trained to replicate dexterous actions such as turning book pages.
    • 10:11Robot Dynamics and Model-Based Control
    • 13:16Imitation Learning, Foundation Models, and Course Wrap-up
  • Sergey Levine

    UC Berkeley · Graduate

    Learning by directly copying observed behavior or inferring intent from demonstrations.
    • 15:17Sequential Decision-Making: Policy Gradients vs. Value-Based Architectures
  • Leslie Kaelbling

    MIT · Graduate

    A machine learning technique where an agent learns to perform a task by observing demonstrations from an expert.
    • 1:00:23The Role of Rationality in Modern Robotics
  • John Langford

    UC Berkeley · Research

    Training a model by mimicking expert demonstrations, which can suffer from distribution shift when stepping off correct sequences.
    • 37:06An Occam's Razor Principle for Transformers?

Lectures that assume it

8

Connections

23

The lectures that define it or assume it, and the concepts next to it.

6 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.