Sign inSign in
ConceptAI & ML

The bitter lesson

The historical observation in AI that general approaches leveraging computation via search and learning ultimately outperform methods that manually build human knowledge into agents.
as Sasha Rush defines itCornell UniversityThe wording closest to all 4 definitions
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Compute scaling2AI research1History of AI research1Machine learning1Neural networks1

Lecturers

4

Each in their own terms, from the easiest level.

  • Adam Brown

    Perimeter Institute · Undergraduate

    The observation that building general methods that leverage massive compute through scale and search ultimately outperforms approaches that rely on human-designed heuristics and clever domain-specific tricks.
    • 21:35Training Sand to Think: Artificial General Intelligence & Future of Physics
  • Sara Hooker

    Adaption Labs · Graduate

    The observation that building on general search and learning methods that leverage massive compute is ultimately the most effective approach to AI in the long run.
    • 10:36Beyond Brute Force: The Era of Adaptive Intelligence
  • Phillip Isola

    MIT · Graduate

    An essay arguing that general methods that leverage computation are ultimately more effective than methods that rely on human-engineered knowledge.

Connections

7

The lectures that define it or assume it, and the concepts next to it.

4 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.