Academic Discipline

AI & Machine Learning

Deep learning, language models, reinforcement learning, statistical learning theory, representation learning, and vision.

10courses86standalone talks213total lectures

Subfields

All AI & ML213 Deep Learning80 Language Models & NLP73 Reinforcement Learning35 Statistical Learning & Causality35 Computer Vision & Graphics28 Mechanistic Interpretability, Alignment & World Models27 Active Inference, Cybernetics & Artificial Life2

Reinforcement Learning— Markov decision processes, value iteration, Q-learning, policy gradients, exploration, and planning.

4 topics

All Reinforcement Learning Policy Gradients & Imitation Learning16 MDPs, Bellman Equations & Q-Learning14 Monte Carlo Tree Search2 Policy Optimization2

jknavigate↵watchcchaptersssavexwatched

Save

The Learning Problem

The Learning Problem

CS 156 · Learning From Data · Lec 1·Statistical Learning & Causality · Yaser Abu-Mostafa · Caltech

Yaser Abu-Mostafa

1:21:27

Decision Transformer: Reinforcement Learning via Sequence Modeling

Decision Transformer: Reinforcement Learning via Sequence Modeling

CS25 · Transformers United · Lec 3·Reinforcement Learning · Ashish Vaswani, Lucas Beyer & William Fedus · Stanford University

Ashish Vaswani&Lucas Beyer

Stanford University

1:20:42

Sequential Decision-Making: Policy Gradients vs. Value-Based Architectures

Sequential Decision-Making: Policy Gradients vs. Value-Based Architectures

CS 285 · Deep Reinforcement Learning · Lec 2·Policy Gradients & Imitation Learning · Sergey Levine · UC Berkeley

29:01

Markov Processes, Reward Processes & Bellman Equations

Markov Processes, Reward Processes & Bellman Equations

Introduction to Reinforcement Learning · Lec 2·MDPs, Bellman Equations & Q-Learning · David Silver · Google DeepMind

Google DeepMind

1:42:04

Imitation Learning I: Behavioral Cloning & Distributional Shift

Imitation Learning I: Behavioral Cloning & Distributional Shift

CS 285 · Deep Reinforcement Learning · Lec 3·Policy Gradients & Imitation Learning · Sergey Levine · UC Berkeley

24:47

Imitation Learning II: Covariate Shift & Dataset Aggregation (DAgger)

Imitation Learning II: Covariate Shift & Dataset Aggregation (DAgger)

CS 285 · Deep Reinforcement Learning · Lec 4·Policy Gradients & Imitation Learning · Sergey Levine · UC Berkeley

23:06

Search with Other Agents: Expectimax, Utilities

Search with Other Agents: Expectimax, Utilities

Introduction to Artificial Intelligence · Lec 7·MDPs, Bellman Equations & Q-Learning · Pieter Abbeel · UC Berkeley

1:25:00

Imitation Learning III: Inverse RL & Generative Adversarial Imitation Learning (GAIL)

Imitation Learning III: Inverse RL & Generative Adversarial Imitation Learning (GAIL)

CS 285 · Deep Reinforcement Learning · Lec 5·Policy Gradients & Imitation Learning · Sergey Levine · UC Berkeley

32:23

Self Attention and Non-parametric transformers (NPTs)

Self Attention and Non-parametric transformers (NPTs)

CS25 · Transformers United · Lec 6·Deep Learning · Ashish Vaswani, Lucas Beyer & William Fedus · Stanford University

Ashish Vaswani&Lucas Beyer

Stanford University

1:05:43

Deep Reinforcement Learning

Deep Reinforcement Learning

Convolutional Neural Networks for Visual Recognition · Lec 14·Deep Learning · Fei-Fei Li, Justin Johnson & Serena Yeung · Stanford University

Fei-Fei Li&Justin Johnson

Stanford University

1:04:01

Policy Gradient Foundations: Trajectory Distributions & High-Dimensional State Spaces

Policy Gradient Foundations: Trajectory Distributions & High-Dimensional State Spaces

CS 285 · Deep Reinforcement Learning · Lec 6·Deep Learning · Sergey Levine · UC Berkeley

26:28

Policy Gradients I: Deriving the REINFORCE Estimator & Policy Objective

Policy Gradients I: Deriving the REINFORCE Estimator & Policy Objective

CS 285 · Deep Reinforcement Learning · Lec 7·Policy Gradients & Imitation Learning · Sergey Levine · UC Berkeley

14:02

Policy Gradients II: Variance Reduction, Baselines & Reward-to-Go Causality

Policy Gradients II: Variance Reduction, Baselines & Reward-to-Go Causality

CS 285 · Deep Reinforcement Learning · Lec 8·Statistical Learning & Causality · Sergey Levine · UC Berkeley

14:52

Policy Gradient Methods

Policy Gradient Methods

Introduction to Reinforcement Learning · Lec 7·Policy Gradients & Imitation Learning · David Silver · Google DeepMind

Google DeepMind

1:33:58

Actor-Critic Methods: Value Function Bootstrapping & Advantage Estimation

Actor-Critic Methods: Value Function Bootstrapping & Advantage Estimation

CS 285 · Deep Reinforcement Learning · Lec 9·Policy Gradients & Imitation Learning · Sergey Levine · UC Berkeley

15:41

Natural Policy Gradients, Covariant Updates & The Fisher Information Matrix

Natural Policy Gradients, Covariant Updates & The Fisher Information Matrix

CS 285 · Deep Reinforcement Learning · Lec 10·Policy Gradients & Imitation Learning · Sergey Levine · UC Berkeley

25:13

Showing 16 of 16 lectures13h shown

More categories

Systems & CS (432)Mathematics (428)Physics & Cosmology (404)History & Humanities (375)Philosophy & Ethics (264)Biology & Neuroscience (281)Economics & Finance (336)Algorithms & Theory (339)Engineering & Robotics (209)