Google Accessibility Updates: SignGemma, Android, Pixel, Chrome & Workspace Features

Sign Language Understanding with SignGemma

• 💡 SignGemma, an open model for sign language understanding, is set to be released later this year, focusing primarily on American Sign Language (ASL) and English.
• 🚀 This model will be trained to translate other sign languages into spoken language text and can be fine-tuned by experts in various sign languages.
• 🤝 As a Gemma model, its core technology will be publicly available, fostering community-driven, accessible tech for the Deaf and Hard of Hearing community.

Android Accessibility Enhancements

• 💬 Gemini's integration with TalkBack now offers AI-generated descriptions for entire screens and allows for conversational follow-up questions.
• 🎭 Expressive Captions on Android have been improved to capture more nuance in speech, including the duration of sounds for emphasis and additional vocalizations like whispers or yawns.

Pixel and Project Astra Innovations

• 🔍 The Magnifier app on Pixel now features live search, allowing users to find items in their surroundings by typing queries and receiving visual and haptic feedback.
• 🌐 Project Astra's Visual Interpreter is a research prototype, developed with Aira, that uses a phone camera to interpret surroundings in real-time for blind and low-vision users, with live Aira agent supervision.

Chrome and Chromebook Accessibility Features

• 📄 Optical Character Recognition (OCR) in Chrome now enables screen readers to interact with scanned PDFs, allowing for highlighting, copying, and searching text.
• 🖱️ Chromebook users can now turn off the touchpad to prevent accidental clicks while using screen readers.
• 🔊 Flash notifications are introduced to alert users of new notifications by flashing the screen, beneficial for those who are hard of hearing or use screen magnification.
• ⌨️ New features for limited dexterity include Bounce Keys (ignores repeated keystrokes) and Slow Keys (requires keys to be held down), along with Mouse Keys for controlling the pointer via the keypad.

Workspace Accessibility Updates

• 🗓️ Users can now embed interactive Google Calendars into websites, featuring screen-reader compatibility, improved spacing, a responsive layout, and keyboard navigation.