Quick Overview
Google rolled out new artificial intelligence (AI) accessibility features for Pixel smartphones and Android devices. These features are designed to help people with vision, hearing, and speech impairments. There are four new features, two for Pixel smartphones only, and two available on all Android devices.
Guided Frame for Pixel Phones
Guided Frame is a new feature exclusive to Pixel smartphones. It helps users with low vision and vision loss take better photos. The feature provides spoken instructions to guide users in positioning their faces correctly within the camera frame.
It tells users to move their faces up or down or pan left and right. The camera will then automatically take the picture. Guided Frame also alerts users if the lighting is not good, helping them find better lighting.
Previously, this guidance was available through Android’s screen reader TalkBack. Now, it’s built directly into the Pixel camera settings.
Upgraded Magnifier App for Pixel Devices
Another feature for Pixel phones is an upgrade to the Magnifier app.
This app, introduced last year, helps users zoom in on objects and text in the real world. With the new AI update, users can now search for specific words in their surroundings. For example, at an airport, users can find flight information, or at a restaurant, they can locate a specific item on the menu.
The app automatically zooms in on the searched word.
The app also now includes a picture-in-picture mode. This allows users to see a smaller, zoomed-out view while focusing on a specific word. Users can also switch between the camera lenses and use the front-facing camera as a mirror.
Upgrades to Live Transcribe for Foldable Phones
Live Transcribe has received an update for foldable smartphones.
In dual-screen mode, each speaker can now see their own transcriptions. This is useful when two people are sitting across from each other, as each side of the screen will show what each person has said. This feature aims to make conversations clearer and easier to follow.
Enhanced Live Captions for More Languages
The Live Captions feature is also getting better.
Google has added seven new languages: Chinese, Korean, Polish, Portuguese, Russian, Turkish, and Vietnamese. This means that users will get real-time captions in these languages when their device plays any sound.
In addition, the Live Transcribe feature now supports 15 languages on-device. This means users can transcribe these languages without an internet connection.
With internet access, the feature supports 120 languages.
Google has emphasized its commitment to working with the disability community. The company aims to bring new tools and innovations to make technology more inclusive and accessible for everyone.
