Skip to main content

AGI Breakthroughs Are Already Here: OpenAI's Bob McGrew on AI's Future

[HPP] Stephanie ZhanJune 17, 202548 min
35 connections·40 entities in this video→

The AI Trifecta and AGI's Foundations

  • πŸ’‘ Bob McGrew identifies three core components of AI: pre-training, post-training, and reasoning.
  • πŸ”‘ He controversially argues that the fundamental concepts for AGI (Transformers, scaled pre-training, reasoning, and multimodality) have already been discovered.
  • 🎯 2025 is predicted to be the "year of reasoning" due to rapid progress and low-hanging fruit, such as the development of tool use in models.

Evolution of AI Training

  • πŸ“ˆ Pre-training is experiencing diminishing returns due to the log-linear relationship between intelligence and compute, but remains vital for improving architectures like efficiency and context handling.
  • 🧠 Post-training focuses on "model personality", which is a
Knowledge graph40 entities Β· 35 connections

How they connect

An interactive map of every person, idea, and reference from this conversation. Hover to trace connections, click to explore.

Hover Β· drag to explore
40 entities
Chapters19 moments

Key Moments

Transcript179 segments

Full Transcript

Topics15 themes

What’s Discussed

Artificial General Intelligence (AGI)TransformersScaled Pre-trainingReasoning ModelsMultimodal CapabilitiesModel PersonalityAI AgentsCompute CostsRoboticsProprietary DataCodingSoftware EngineeringCybersecurityLanguage Models (LLMs)Vision Encoders
Smart Objects40 Β· 35 links
CompaniesΒ· 3
ConceptsΒ· 23
PeopleΒ· 4
ProductsΒ· 9
EventΒ· 1