ConceptAI & ML
Mechanistic interpretability
Mechanistic interpretability tries to understand how individual components and operations in a machine learning model contribute to its overall decision-making process.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Neural networks3Large language models2Machine learning models1Network parameters1Neural network representations1
Lecturers
3Each in their own terms, from the easiest level.
Steven Feng
Techniques used to understand a model's internal representations, circuits, and features rather than just looking at its final outputs.Ashish Vaswani, Lucas Beyer & William Fedus
Mechanistic interpretability aims to map neural network parameters to human understandable algorithms.Blake Richards
The field of neuroscience and machine learning that studies how large language models solve problems by analyzing internal states and components like attention heads.
Connections
6The lectures that define it or assume it, and the concepts next to it.