Google AI & Accessibility Updates for Android & Chrome

Google Enhances Android and Chrome with New AI and Accessibility Tools

On Thursday, Google revealed the launch of innovative AI and accessibility functionalities for both Android and Chrome platforms.

A key update involves TalkBack, Android’s integrated screen reader. It now leverages Gemini to provide insights into images and the current screen content.

Expanded Gemini Integration with TalkBack

Last year saw the initial integration of Gemini’s capabilities within TalkBack, offering individuals with visual impairments access to AI-generated image descriptions, even in the absence of Alt text.

Users can now pose questions and receive detailed responses pertaining to their images.

For instance, if a photograph of a new guitar is received via text message, a description can be obtained, along with inquiries about its brand and color.

Furthermore, descriptions and question-answering capabilities now extend to the entire phone screen.

While shopping within an application, users can query Gemini regarding the material composition of a desired item or the availability of discounts.

Expressive Captions Receive Updates

Google also announced enhancements to Expressive Captions, Android’s real-time captioning feature powered by AI. This feature captures not only what is said, but also *how* it is said.

Recognizing that vocal emphasis is a crucial aspect of expression, Google has introduced a new duration feature to Expressive Captions.

This allows the system to identify elongated sounds, such as a sports announcer’s enthusiastic call of an “amaaazing shot” or a drawn-out “nooooo” conveying strong disagreement.

New labels for sounds, like whistling or throat-clearing, will also be implemented.

Availability and Regional Rollout

The updates are currently being deployed in English within the United States, the United Kingdom, Canada, and Australia.

Compatibility requires devices running Android 15 or a later version.

Improved PDF Accessibility in Chrome

Google is streamlining access to PDFs within the Chrome browser.

Previously, screen readers were unable to interact with scanned PDFs in the desktop version of Chrome.

Now, Chrome automatically identifies these PDFs, enabling text highlighting, copying, searching, and screen reader functionality.

This improvement is made possible through the integration of Optical Character Recognition (OCR) technology.

Enhanced Page Zoom on Android Chrome

Chrome on Android now offers an improved Page Zoom feature.

This allows users to increase text size without disrupting the overall webpage layout.

Zoom preferences can be customized and applied globally to all visited pages, or selectively to specific websites.

The feature is accessible via the three-dot menu located in the top-right corner of the Chrome browser.