OpenAI's Mark Chen & Jakub Pachocki on GPT-5, Automated Research, and AI's Future
[HPP] Jakub PachockiSeptember 25, 202553 min
39 connectionsΒ·40 entities in this videoβGPT-5 and Advanced Reasoning
- π‘ GPT-5 was launched to bring reasoning into the mainstream, enabling more agentic behavior by default.
- π§ The model combines instant responses with the ability to think for a long time to provide the best answer, simplifying user experience.
Measuring AI Progress
- π Traditional evaluations (evals) are becoming saturated, with models reaching near-perfect scores.
- π― OpenAI is now focused on models that can discover new things and demonstrate economically relevant movement, particularly in math and programming competitions.
The Automated Researcher Vision
- π A primary research target is to create an automated researcher capable of discovering new ideas, including in ML and other sciences.
- π This involves extending the model's reasoning horizon and ability to plan over very long periods, from hours to months or years.
Reinforcement Learning's Impact
- β Reinforcement Learning (RL) has proven to be a highly versatile and effective method, especially when combined with natural language understanding.
- π οΈ While reward modeling is currently complex, it is expected to evolve and simplify, moving towards more human-like learning paradigms.
Evolving Coding and Research
- π» GPT-5 Codecs focuses on making AI intelligence useful for real-world coding, handling messy environments and optimizing for problem difficulty.
- π‘ The ultimate goal is to transition from "vibe coding" to "vibe researching," where AI assists in the discovery of new ideas, requiring persistence and learning from failures.
OpenAI's Research Culture
- π OpenAI maintains a culture of fundamental research, attracting talent by focusing on ambitious, frontier problems rather than copying competitors.
- π§ The organization balances research and product by protecting dedicated research space, prioritizing algorithmic advances, and allocating compute resources strategically.
Knowledge graph40 entities Β· 39 connections
How they connect
An interactive map of every person, idea, and reference from this conversation. Hover to trace connections, click to explore.
Hover Β· drag to explore
40 entities
Chapters20 moments
Key Moments
Transcript194 segments
Full Transcript
Topics15 themes
Whatβs Discussed
GPT-5Automated ResearcherReinforcement Learning (RL)Reasoning ModelsAgentic SystemsCodecsEvaluations (Evals)Reward ModelingFundamental ResearchResearch CultureCompute ResourcesDeep LearningNatural Language ProcessingProblem SolvingAI Progress
Smart Objects40 Β· 39 links
CompaniesΒ· 2
PeopleΒ· 4
ProductsΒ· 7
ConceptsΒ· 25
MediasΒ· 2