ConceptAI & ML
Sparse representation
A representation where many components of the vector are zero, typical of ReLU activations in high dimensions.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Lecturers
2Each in their own terms, from the easiest level.
Terence Tao
A property where many components of a transform are negligible and can be ignored, meaning most coefficients are zero or close to zero.
Connections
4The lectures that define it or assume it, and the concepts next to it.