ConceptAI & ML
Linear probe
A technique where a linear projection is trained on top of a frozen representation space to evaluate the quality of learned representations.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Representation learning2Encoder1Large language models1Linear classification1Linear classifier1Linear decoding1Linear model1Linear regression1
Lecturers
5Each in their own terms, from the easiest level.
Phillip Isola
A linear operation trained on top of a frozen representation for a new prediction problem.Ilya Sutskever
Evaluating learned representations by training a linear classifier on top of a frozen neural network layer.William Gilpin
A simple linear model trained on top of frozen representations to evaluate what features are encoded.Yasaman Bahri
A method used to linearly decode variables from the internal representations of Large Language Models to check what concepts the model has learned.
Connections
9The lectures that define it or assume it, and the concepts next to it.