ConceptAI & ML
Model distillation
Transferring knowledge from a large complex teacher model to a smaller, more efficient student model.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Opens up
Concepts that name this one as a prerequisite.
Lecturers
2Each in their own terms, from the easiest level.
Song Han
Using multiple large teacher neural networks to teach a small student neural network so it can perform as well as the larger models.
Connections
4The lectures that define it or assume it, and the concepts next to it.