Google Accessibility Updates: SignGemma, Android, Pixel, Chrome & Workspace Features

Sign Language Understanding with SignGemma

• 💡 Later this year, Google will release SignGemma, an open model for sign language understanding, initially focusing on American Sign Language (ASL).
• 🚀 This model is designed to translate sign languages into spoken language text and can be fine-tuned by experts for other languages.
• 🔑 Its core technology will be publicly available, fostering community-driven accessible tech for the Deaf and Hard of Hearing community.

Android Accessibility Enhancements

• 💬 Gemini's integration with TalkBack now allows AI-generated descriptions for entire screens and conversational questions about images.
• 🔊 Expressive Captions in Live Caption on Android have been improved to capture more nuance in speech, including emphasis and various sounds like whispers or yawns.

Pixel and Project Astra Innovations

• 🔍 The Magnifier app on Pixel now features live search, allowing users to type search queries and find items in their surroundings with visual and haptic feedback.
• 🤝 Project Astra's Visual Interpreter, developed with Aira, is a research prototype for blind and low-vision users to scan surroundings and ask questions about what they see.

Chrome and Chromebook Accessibility Features

• 📄 Optical Character Recognition (OCR) in Chrome now enables screen reader interaction with scanned PDFs, allowing text highlighting, copying, and searching.
• 🖱️ Chromebooks will feature Touchpad Off functionality, beneficial for screen reader users to prevent accidental clicks.
• 🔔 Flash Notifications will alert users with a screen flash for new notifications, aiding those who are hard of hearing or use screen magnification.
• ⌨️ New keyboard features for limited dexterity include Bounce Keys (ignores rapid keystrokes), Slow Keys (requires keys to be held), and Mouse Keys (controls pointer via keypad).

Workspace Accessibility Updates

• 🗓️ Interactive Google Calendars can now be embedded into websites, offering screen-reader compatibility, improved readability, and keyboard navigation.