Opening From Large Language Models to General Artificial Intelligence?
From Large Language Models to General Artificial Intelligence?
- Length
- 20 min
- Level
- Graduate
- Recorded
- Furhat Robotics2023 · Conference Talk
Chapter 1 of 4: Before the talk
Bach argues that nothing in principle stops large language models from reaching general intelligence.
Whether large language models can lead to artificial general intelligence is the question Joscha Bach tests against a capability space he calls the Big Nine. Bach contrasts the bottom-up semantics language models learn from patterns with the top-down, embodied semantics of human minds. He weighs the critiques of Hubert Dreyfus and Gary Marcus, then sorts out functional limits in reliability, coherence and creativity. Creativity, on his account, demands authorship: generation that modifies the generative system itself. Hybrid mechanisms, a minimal agent modelled as a controller of future states, and Minsky's society of mind sketch how perception, reasoning and agency could be added.

Your comment is kept while you sign up.Sign in
Whether large language models can lead to artificial general intelligence is the question Joscha Bach tests against a capability space he calls the Big Nine. Bach contrasts the bottom-up semantics language models learn from patterns with the top-down, embodied semantics of human minds. He weighs the critiques of Hubert Dreyfus and Gary Marcus, then sorts out functional limits in reliability, coherence and creativity. Creativity, on his account, demands authorship: generation that modifies the generative system itself. Hybrid mechanisms, a minimal agent modelled as a controller of future states, and Minsky's society of mind sketch how perception, reasoning and agency could be added.
What Computers Can't Do
This lecture
Choose a node to see how it connects to this lecture. What comes before is on the leftat the top. The ring is what it teaches. People and places are above. Other lectures and books are below.
Press a chosen node again to open it.