AGI Breakthroughs Are Already Here: OpenAI's Bob McGrew on AI's Future
[HPP] Stephanie ZhanJune 17, 202548 min
35 connectionsΒ·40 entities in this videoβThe AI Trifecta and AGI's Foundations
- π‘ Bob McGrew identifies three core components of AI: pre-training, post-training, and reasoning.
- π He controversially argues that the fundamental concepts for AGI (Transformers, scaled pre-training, reasoning, and multimodality) have already been discovered.
- π― 2025 is predicted to be the "year of reasoning" due to rapid progress and low-hanging fruit, such as the development of tool use in models.
Evolution of AI Training
- π Pre-training is experiencing diminishing returns due to the log-linear relationship between intelligence and compute, but remains vital for improving architectures like efficiency and context handling.
- π§ Post-training focuses on "model personality", which is a
Knowledge graph40 entities Β· 35 connections
How they connect
An interactive map of every person, idea, and reference from this conversation. Hover to trace connections, click to explore.
Hover Β· drag to explore
40 entities
Chapters19 moments
Key Moments
Transcript179 segments
Full Transcript
Topics15 themes
Whatβs Discussed
Artificial General Intelligence (AGI)TransformersScaled Pre-trainingReasoning ModelsMultimodal CapabilitiesModel PersonalityAI AgentsCompute CostsRoboticsProprietary DataCodingSoftware EngineeringCybersecurityLanguage Models (LLMs)Vision Encoders
Smart Objects40 Β· 35 links
CompaniesΒ· 3
ConceptsΒ· 23
PeopleΒ· 4
ProductsΒ· 9
EventΒ· 1