Sign inSign in
ConceptEngineering

Sparsity

A structural property of a matrix where a large number of its entries are zero.
as Stephen Boyd defines itStanford UniversityThe wording closest to all 7 definitions
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Opens up

Concepts that name this one as a prerequisite.

Lecturers

5

Each in their own terms, from the easiest level.

  • Onur Mutlu

    ETH Zürich · Undergraduate

    The property of matrices in machine learning and other applications where a large number of values are zeros.
    • 41:28GPU Architectures II & Memory Overview and Technology (ETH Zürich, Digital Design and Computer Architecture, Lecture 20)
    • 3:42:55Arch4Health: 4th Workshop on Architecture for Health
  • Stephen Boyd

    Stanford University · Undergraduate

    A matrix property where a large portion of the entries are zero, allowing algorithms to skip unnecessary computations.
    • 50:11Numerical Linear Algebra Background
  • Charles Leiserson & Julian Shun

    MIT · Undergraduate

    A property of data structures where most elements are zero, allowing for optimizations by ignoring these zero elements.
    • 26:37Bentley Rules for Optimizing Work
  • Leslie Kaelbling

    MIT · Graduate

    A property where most factors do not change most of the time.
    • 12:30The Role of Rationality in Modern Robotics
  • Ashish Vaswani, Lucas Beyer & William Fedus

    Stanford University · Graduate

    A new dimension for scaling model architectures where each input is routed to sparsely used parameters with a fixed computation per example.
    • 2:34Mixture of Experts (MoE) paradigm and the Switch Transformer

Lectures that assume it

14

The first 12 are shown.

Connections

30

The lectures that define it or assume it, and the concepts next to it.

Concepts9

Show 3 more

Lectures21

Show 15 more

5 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.