Sign inSign in
ConceptAI & ML

Encoder-decoder architecture

An architecture where an encoder compresses the input into a low-dimensional representation and a decoder reconstructs the output from it.
as Sara Beery defines itMITThe wording closest to all 4 definitions
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Opens up

Concepts that name this one as a prerequisite.

Lecturers

4

Each in their own terms, from the easiest level.

  • Brian Yu

    Harvard University · Undergraduate

    An architecture where an encoder encodes an input question into a hidden state, and a decoder decodes that hidden state into the desired output.
    • 11:27:18Harvard CS50’s Artificial Intelligence with Python – Full University Course
  • Hyung Won Chung

    Stanford University · Undergraduate

    An architecture featuring separate encoder and decoder stacks where cross-attention connects the decoder to the final encoder layer output and the output is a sequence.
    • 20:00Shaping the Future of AI from the History of Transformer Architectures
  • Ashish Vaswani, Lucas Beyer & William Fedus

    Stanford University · Undergraduate

    An architecture where an encoder reads and processes the entire input sequence and a decoder generates the output sequence token by token.
    • 13:48Transformers United: DL Models that have revolutionized NLP, CV, RL

Lectures that assume it

2

Connections

16

The lectures that define it or assume it, and the concepts next to it.

4 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.