Sign inSign in
ConceptSystems & CS

Throughput

The amount of data or number of queries a system can process in a given time.
as Ippokratis Pandis defines itCarnegie Mellon UniversityThe wording closest to all 4 definitions
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Batch size1CPI1Instruction processing cycle1Performance1Performance equation1System performance1Time1Tokenization1

Opens up

Concepts that name this one as a prerequisite.

Lecturers

4

Each in their own terms, from the easiest level.

  • Martin Thompson

    GOTO Conferences · Undergraduate

    Units of some work done per unit of something of time.
    • 3:33Mechanical Sympathy: Designing Software for Modern CPU Caches
  • Onur Mutlu

    ETH Zürich · Undergraduate

    The number of instructions processed per unit of time, improved in pipelining by overlapping operations.
    • 1:11:57Multi-Cycle and Pipelined Processor Design
  • Andrej Karpathy

    Graduate

    The number of tokens of data processed per second during training.
    • 1:36:25Let's Reproduce GPT-2 (124M): Distributed PyTorch, FlashAttention & FineWeb

Connections

8

The lectures that define it or assume it, and the concepts next to it.

4 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.