Sign inSign in
ConceptAI & MLBio & Neuro1 more

Attention

One word, taught differently in 3 fields. Each use is given apart.

In AI & ML

A mechanism where weights are dynamically determined as a function of the input data.
as Sara Beery defines itMITThe wording closest to all 3 definitions

In Bio & Neuro

A process that improves the processing of whatever is attended and often determines what we see, hear, and perceive.

In Psychology

Attention can be crudely viewed as a flashlight, a spotlight on experience that willingly zooms in on something and makes it memorable.

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Opens up

Concepts that name this one as a prerequisite.

In AI & ML

3

Each in their own terms, from the easiest level.

  • Phillip Isola

    MIT · Undergraduate

    An operation that allows a network to look globally and sparsely by attending to the specific parts of the input signal that matter for a given question.
    • 6:15Architectures: Transformers
  • Trenton Bricken

    Stanford University · Graduate

    A mechanism in Transformers that computes a weighted sum of value vectors based on the similarity between a query and keys.
    • 8:05Neuroscience-Inspired Artificial Intelligence

In Bio & Neuro

2

Each in their own terms, from the easiest level.

  • Nancy Kanwisher

    MIT · Undergraduate

    A filter that lets attended or selected information into awareness while completely filtering out unattended information.
    • 20:21Attention and Awareness

In Psychology

1

    Lectures that assume it

    4

    Connections

    19

    The lectures that define it or assume it, and the concepts next to it.

    6 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.