Meta CTO Andrew Bosworth on Ray-Ban Smart Glasses and Neural Band

Ray-Ban Meta Glasses: Display and Design

• 💡 Meta's Ray-Ban Display glasses feature an LCOS display with input gratings that are nearly invisible, minimizing light leakage to 2%.
• 🚀 The design utilizes geometric waveguides, offering high brightness and resolution, though with some limitations on field of view.
• ✨ Chunky frames are noted as a current design trend that coincidentally works well with the integrated technology.
• 🎨 Semi-translucent frames offer a subtle integration of electronics, not fully obvious at first glance but visible upon closer inspection.

Neural Band: A Universal Interface

• 🧠 The neural input band is highlighted as a potentially universal interface, capable of mapping electrical signals to hand gestures.
• ⚡ It aims to become a significant input platform, enabling actions like controlling a TV remote with simple wrist movements.
• ✍️ The system uses a machine-learned model that adapts over time, personalizing gesture recognition for individual users, including handwriting.
• 🤝 While currently designed to work with the glasses, the technology has the potential to connect with other devices in the future.

User Experience and Future Potential

• 🎯 Meta prioritizes features that address the top 10 reasons people reach for their phones, aiming for seamless integration.
• 📈 The UI is designed for ease of use, with a goal to maximize task completion and minimize screen time.
• 🏃‍♂️ The fitness front is a key area of focus, with partnerships with Garmin and Strava, and potential for integrating heart rate and pace data into smaller, lighter displays.
• ⌨️ Two neural bands can enable faster typing, and while downward-facing cameras are an option for typing, they add cost and complexity.

Accessibility and Prescription Lenses

• ♿ The neural band shows promise for individuals with limited motor control or who have lost a limb, with ongoing research into training the device.
• 👓 Current prescription support for the Ray-Ban Meta glasses is limited to -4 to +4 diopters due to flat lenses, with research underway to incorporate curvature for broader correction.
• 🔊 For low-vision users, audio assistance is available, and for low-hearing users, display assistance is provided.

The Future of Apps and AI Platforms

• 🌐 Meta envisions the glasses as an AI platform, integrating vision and audio data to create closed-loop interactions.
• 📱 The future likely involves a more AI-driven interface rather than a traditional app store model for glasses.
• 🛠️ The platform aims to support a wide range of consumer applications, building on the foundation of early-stage development.