Skip to main content

Has AI Hit a Wall? Scaling Laws and the Future of AI Development

[HPP] Gary MarcusDecember 5, 202513 min
36 connections·40 entities in this video→

The Shifting Landscape of AI Scaling

  • đź’ˇ Nvidia's record revenue of $57 billion in a quarter, followed by a stock crash, signals a fundamental shift in the world of artificial intelligence.
  • 🚀 For years, AI scaling laws (more data, larger models, more computing power) drove dramatic improvements, making systems like GPT-3 to GPT-5 progressively smarter.
  • ⚠️ This
Knowledge graph40 entities · 36 connections

How they connect

An interactive map of every person, idea, and reference from this conversation. Hover to trace connections, click to explore.

Hover · drag to explore
40 entities
Chapters3 moments

Key Moments

Transcript47 segments

Full Transcript

Topics13 themes

What’s Discussed

AI Scaling LawsLarge Language ModelsIlya SutskeverYann LeCunGary MarcusAI HallucinationsWorld ModelsAI InfrastructureNvidiaDot-com BubbleData ScarcityDeep LearningGPT Models
Smart Objects40 · 36 links
Companies· 7
People· 9
Events· 3
Concepts· 9
Products· 7
Medias· 5