Skip to main content

AI for Video Content: Multimodal Agents with Meenal Nalwaya of Reka

The Agile Brand with Greg KihlstromยฎSeptember 27, 202518 min7,641 views
30 connectionsยท36 entities in this videoโ†’

Reka's Multimodal AI Approach

  • ๐Ÿ’ก Reka focuses on building enterprise-standard multimodal agents that can process and reason across visual and audio data, not just text.
  • ๐ŸŽฏ Their differentiation lies in being multimodal-first, addressing the vast amount of untapped visual and audio data, and being a full-stack company that builds its own foundational models.
  • ๐Ÿ”‘ This full-stack approach provides control over quality, customization, and development speed, avoiding reliance on third-party roadmaps.

Key Platform Capabilities: Recision and Research

  • ๐Ÿ‘๏ธ Recision enables human-like understanding of images and videos, allowing users to search and ask questions directly about visual content.
  • ๐Ÿ“ˆ Examples include generating highlight reels from sports footage or identifying security events from surveillance feeds.
  • ๐Ÿง  Reka Research adds a reasoning layer, enabling deep research across private enterprise data and the web, providing structured and cited answers.
  • ๐Ÿ“Š This combination of perception (Recision) and reasoning (Research) forms the building blocks for advanced multimodal agents.

Real-World Applications and Impact

  • ๐Ÿš“ In security, Reka solutions with the Ohio Police Department led to a 65% faster case resolution and a 42% reduction in crime, saving officers significant time.
  • ๐ŸŽฌ For media companies like Paramount, Reka unlocks value from vast video archives by making content searchable at granular levels (scene, theme, actor, emotion), improving licensing and discovery.
  • ๐Ÿ“บ This enhanced discovery can lead to more consumer engagement and higher licensing values, transforming how content is found and consumed on platforms like Netflix.
  • ๐Ÿ“ฐ News media can repurpose existing content into new formats quickly for social media using Reka's reel generation, increasing audience engagement without additional production costs.
  • ๐Ÿ’ฐ Publishers can also increase advertising and sponsorship revenue by proving ROI through logo appearance tracking and selling premium ad placements during moments of excitement.

Future of AI and Advice for PMs

  • ๐Ÿš€ The AI landscape is shifting from text-centric to multimodal, with images, video, and audio becoming increasingly important data sources.
  • ๐Ÿข A contrarian view suggests a move towards full-stack AI companies for greater control over quality, reliability, and pricing as complex use cases emerge.
  • ๐ŸŽฏ For Product Managers in AI, the advice is to anchor on customer problems and leverage evaluations as the new KPIs to ensure products solve real pain points and are built in the right direction.
  • ๐Ÿ’ก PMs remain crucial for defining the 'what' and 'why', even with advanced coding tools, making it an exciting time for the role.
Knowledge graph36 entities ยท 30 connections

How they connect

An interactive map of every person, idea, and reference from this conversation. Hover to trace connections, click to explore.

Hover ยท drag to explore
36 entities
Chapters8 moments

Key Moments

Transcript69 segments

Full Transcript

Topics13 themes

Whatโ€™s Discussed

Multimodal AIGenerative AIRekaAI AgentsComputer VisionVideo AnalysisEnterprise AIAI Product ManagementData AnalysisMedia TechnologySecurity TechnologyAI EthicsAI Strategy
Smart Objects36 ยท 30 links
Companiesยท 6
Peopleยท 3
Conceptsยท 20
Productsยท 7