ConceptAI & ML
Scaling law
Scaling law dictates that increasing compute and model size predictably improves performance.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Lecturers
3Each in their own terms, from the easiest level.
Adam Brown
A scaling law states that spending more compute to train a larger neural network yields better performance on a linear log-log plot.Phillip Isola
The observation that model accuracy improves predictably as either train-time compute or test-time compute increases.
Connections
6The lectures that define it or assume it, and the concepts next to it.