Sign inSign in
ConceptAI & ML

Linear attention

An alternative attention mechanism that reduces the complexity from quadratic to linear by altering the computation order.
as Sayak Paul defines itStanford University
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Quadratic time complexity1Self-attention1

Opens up

Concepts that name this one as a prerequisite.

Lecturers

1

    Connections

    3

    The lectures that define it or assume it, and the concepts next to it.

    Concepts2

    1 lecturer. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.