Skip to main content

GPT-5’s launch is not going well… Are we entering the AI “Trough of Disillusionment"?

[HPP] Gary MarcusAugust 12, 20259 min
29 connections·37 entities in this video

GPT-5 Launch Reception

  • ⚠️ The launch of GPT-5 has been met with a tepid response, feeling more like an incremental upgrade rather than a revolutionary breakthrough.
  • 💡 Many users and experts note that the improvements are less striking due to the progress made by competitors like Claude, which offer comparable performance.
  • 💬 Some suggest the name "GPT-5" might have been reserved for a more spectacular model given its brand equity.

Performance Benchmarks and Initial Feedback

  • 📊 GPT-5 shows improvement over previous GPT models, particularly in coding capabilities, scoring 74.9% on the software benchmark verified test.
  • ⚡ However, anecdotal feedback from the engineering community is mixed, with some engineers finding GPT-5 too slow and preferring Claude Sonnet for agentic tasks.
  • 📉 Comparisons on Agentic tasks show GPT-5 not performing as well as Claude Opus.

Expert Reviews and Capabilities

  • 🧪 Reviews from teams like Every.to found GPT-5 good at everyday tasks, pair programming, and writing, but it fell flat in agentic engineering and editing.
  • 🎨 In contrast, Latent Space's "vibe tests" highlighted GPT-5's ability to solve complex dependency conflicts and excel at "vibe coding apps," creating functional features with surprising detail.
  • 🚀 Latent Space reviewers praised GPT-5 as "unequivocally the best coding model in the world," suggesting a significant leap in software engineering automation.

Criticisms and Limitations

  • 🗣️ Former Uber exec and AI critic Gary Marcus described the launch as "shambolic," arguing GPT-5 still struggles with fundamental problems like errors, hallucinations, and a lack of reasoning and generalization.
  • 🧠 Marcus contends that the "pure scaling approach" has reached its limits, and the core architecture is insufficient for achieving AGI, advocating for new approaches like neuro-symbolic AI.
  • 🔬 A study from Arizona State University cited by Marcus indicates that even the latest models, including GPT-5, fail to generalize well outside their training data.

OpenAI's Market Position

  • 📈 Despite the mixed reception, OpenAI still dominates the B2B space through its APIs, though reports show a slight decline in market share.
  • 📱 For consumers, ChatGPT remains the number one AI product, with 700 million weekly active users, and has become a "verb" in daily vocabulary.
  • ⚖️ Elon Musk's XAI plans to sue Apple over the "excessive unfair promotion" of ChatGPT, highlighting its strong market presence.
Knowledge graph37 entities · 29 connections

How they connect

An interactive map of every person, idea, and reference from this conversation. Hover to trace connections, click to explore.

Hover · drag to explore
37 entities
Chapters4 moments

Key Moments

Transcript36 segments

Full Transcript

Topics15 themes

What’s Discussed

GPT-5OpenAIAI Trough of DisillusionmentClaude OpusCoding CapabilitiesAgentic TasksPerformance BenchmarksGary MarcusHallucinationsGeneralizationNeuro-symbolic AIB2B MarketConsumer AI ProductsChatGPTAI Models
Smart Objects37 · 29 links
Products· 15
Companies· 6
Media· 1
Concepts· 13
Location· 1
Event· 1