Sign inSign in
ConceptAI & ML

Emergent abilities

Capabilities that are absent in smaller language models but present in larger ones, appearing suddenly above a certain compute threshold.
as Jason Wei & Hyung Won Chung defines itStanford UniversityThe wording closest to all 4 definitions
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Scaling laws3Large language models2Model scale2Model performance metrics1

Opens up

Concepts that name this one as a prerequisite.

Lecturers

4

Each in their own terms, from the easiest level.

  • Steven Feng

    Stanford University · Undergraduate

    Capabilities present in large models that are absent in smaller models and appear unpredictably at scale.
    • 18:17Overview of Transformers
  • Steven Feng, Div Garg & Karan Singh

    Stanford University · Graduate

    An ability is emergent if it is present in larger but not smaller models and cannot be directly predicted by extrapolating from smaller models.
    • 0:42Beyond LLMs: Agents, Emergent Abilities, Intermediate-Guided Reasoning, BabyLM
  • Irina Rish

    Université de Montréal, MILA · Research

    Capabilities that appear abruptly at certain scale thresholds, which depend on the metrics used.
    • 1:03:41Emergent Behaviors in Foundational Models

Connections

7

The lectures that define it or assume it, and the concepts next to it.

4 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.