ConceptAI & ML
Emergent abilities
Capabilities that are absent in smaller language models but present in larger ones, appearing suddenly above a certain compute threshold.
Know first
Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.
Opens up
Concepts that name this one as a prerequisite.
Lecturers
4Each in their own terms, from the easiest level.
Steven Feng
Capabilities present in large models that are absent in smaller models and appear unpredictably at scale.Steven Feng, Div Garg & Karan Singh
An ability is emergent if it is present in larger but not smaller models and cannot be directly predicted by extrapolating from smaller models.Irina Rish
Capabilities that appear abruptly at certain scale thresholds, which depend on the metrics used.
Connections
7The lectures that define it or assume it, and the concepts next to it.