ConceptSystems & CS
Throughput
The amount of data or number of queries a system can process in a given time.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Batch size1CPI1Instruction processing cycle1Performance1Performance equation1System performance1Time1Tokenization1
Opens up
Concepts that name this one as a prerequisite.
Lecturers
4Each in their own terms, from the easiest level.
Martin Thompson
Units of some work done per unit of something of time.Onur Mutlu
The number of instructions processed per unit of time, improved in pipelining by overlapping operations.Andrej Karpathy
The number of tokens of data processed per second during training.
Connections
8The lectures that define it or assume it, and the concepts next to it.