Sign inSign in
ConceptAI & ML

Query vector

A vector formed from the first two elements of a trigram by rotating them to query language profiles.
as Pentti Kanerva defines itStanford University
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Language profiles1Linear layer1Matrix multiplication1Vector rotation1

Lecturers

2

Each in their own terms, from the easiest level.

  • Andrej Karpathy

    Undergraduate

    A vector emitted by each token representing what information that token is looking for.
    • 1:04:13Let's Build GPT: From Scratch, in Code, Spelled Out

Connections

4

The lectures that define it or assume it, and the concepts next to it.

Concepts2

Lectures2

2 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.