Attention
One word, taught differently in 3 fields. Each use is given apart.
In AI & ML
A mechanism where weights are dynamically determined as a function of the input data.
In Bio & Neuro
A process that improves the processing of whatever is attended and often determines what we see, hear, and perceive.
In Psychology
Attention can be crudely viewed as a flashlight, a spotlight on experience that willingly zooms in on something and makes it memorable.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Opens up
Concepts that name this one as a prerequisite.
In AI & ML
3Each in their own terms, from the easiest level.
Phillip Isola
An operation that allows a network to look globally and sparsely by attending to the specific parts of the input signal that matter for a given question.Trenton Bricken
A mechanism in Transformers that computes a weighted sum of value vectors based on the similarity between a query and keys.
In Bio & Neuro
2Each in their own terms, from the easiest level.
Nancy Kanwisher
A filter that lets attended or selected information into awareness while completely filtering out unattended information.
In Psychology
1Lectures that assume it
4Connections
19The lectures that define it or assume it, and the concepts next to it.
Concepts9
- Neural networks
- Convolutional neural networks
- Linear combination
- Perception
- Change blindness
- Exogenous attention