ConceptAI & ML
Neural scaling laws
Language modeling performance follows a predictable power-law scale with model size in terms of either compute or parameters.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Opens up
Concepts that name this one as a prerequisite.
Lecturers
2Each in their own terms, from the easiest level.
Irina Rish
Functional forms that describe how neural network systems scale with respect to resource factors like dataset size, model size, and compute.
Connections
6The lectures that define it or assume it, and the concepts next to it.