Google Labs Leaders on Veo, Mariner, & NotebookLM: Reshaping AI Collaboration & Creativity
[HPP] Sonya HuangJune 3, 202553 min
35 connectionsยท40 entities in this videoโGoogle's AI Vision & Progress
- ๐ก Google's AI models and the number of products leveraging them have rapidly shifted public opinion, signaling a new chapter for AI at Google.
- ๐ Internally, the team feels they are at the end of Chapter 1 and the start of Chapter 2 for Gen AI, building on three years of continuous improvement.
- โ Google's models are achieving state-of-the-art performance and leading on many leaderboards, enabling unique capabilities.
Creative AI with Veo & Whisk
- ๐จ Google Labs has been experimenting in creative AI for 2.5-3 years, focusing on iterative creation, "media with a blueprint," and show-and-tell interfaces.
- ๐ฌ Flow targets AI filmmakers with a "generative AI camera" for world-building and shooting, while Whisk is a consumer-focused tool for visual language and remixable content.
- ๐ฅ Veo3 shows significant progress in video generation, including improved adherence, physics, and the ability to co-generate audio with video.
- ๐ The future of creative AI involves refining outputs, enabling insertion/editing, and exploring new interactive formats where creators share experiences that others can engage with.
- ๐ฐ There's optimism for continued cost reductions and speed increases in video generation, aligning with trends seen in other AI models.
Agentic Computing: Project Mariner
- ๐งญ Project Mariner is designed to enable users to explore and agents to take action, leveraging Gemini's multimodal capabilities to plan, reason, and understand screenshots.
- โ๏ธ Initially a Chrome extension, Mariner evolved to run tasks in background virtual machines (VMs), allowing users to perform multiple tasks simultaneously.
- ๐ง A key feature is the ability to remember context across browser tabs, enabling agents to complete complex tasks like adding recipe ingredients to a shopping cart.
- ๐ฎ The future of Mariner includes integrating its capabilities into other Google products, making agents smarter with tool use and memory, and expanding its operating environment beyond the browser.
- ๐๏ธ Agentic computing is expected to disrupt e-commerce business models, potentially leading to a "universal cart" and a focus on product quality over ad visibility.
Personalized Knowledge with NotebookLM
- ๐ NotebookLM gained viral success with audio overviews, pioneering personal content designed for an "audience of one."
- ๐ก The product provides "superpowers" to accumulate information, bundle intelligence with thinking models, and adapt content into various formats like mind maps, comics, or short movies.
- ๐๏ธ While audio overviews continue to improve to overcome the "uncanny valley," future developments include more show types (e.g., for LinkedIn profile feedback) and novel mobile experiences like a native voice recorder.
- ๐ฏ NotebookLM aims to be more useful for longer-running projects for knowledge workers and students, focusing on "units of knowledge" and high-value use cases.
Future of AI & Google Labs
- ๐ฎ Predictions for 2025's hottest application space include video and remixable content, where users can easily build upon and interact with each other's creations.
- โ ๏ธ A recurring challenge and advantage for Google Labs has been being "too early" with innovative concepts, which now provides a jump start as models mature.
- โ Key convictions that have proven right include the importance of "show and tell" interfaces over lengthy text prompts and the long-term viability of LLM technology despite initial cost concerns.
- ๐ The expectation is for continued rapid advancements in model capabilities and significant reductions in inference costs, enabling even more ambitious AI applications.
Knowledge graph40 entities ยท 35 connections
How they connect
An interactive map of every person, idea, and reference from this conversation. Hover to trace connections, click to explore.
Hover ยท drag to explore
40 entities
Chapters20 moments
Key Moments
Transcript200 segments
Full Transcript
Topics15 themes
Whatโs Discussed
Generative AIHuman-AI CollaborationVideo GenerationCreative ToolsProject MarinerComputer Use AgentsE-commerce DisruptionNotebookLMPersonalized AI ContentAudio OverviewsGemini ModelMultimodal AIShow and Tell InterfacesAI FilmmakersInference Costs
Smart Objects40 ยท 35 links
Companiesยท 6
Productsยท 15
Peopleยท 4
Conceptsยท 11
Mediasยท 4