Google launches Guided Vision in Gemini Live for people with visual impairments — The Verge

Google has launched the Guided Vision feature in Gemini Live on compatible Android devices. It uses artificial intelligence to provide real-time voice descriptions of objects that a user points their smartphone camera at. As The Verge reports, the tool is intended in particular for blind people and users with visual impairments.

Text and object descriptions

Guided Vision can be used to read small text, receive descriptions of the surroundings, find or identify nearby objects, and learn details about a specific object. Users can ask Gemini additional questions about what they see through the camera. For example, after finding a product, they can ask the assistant to state the expiration date indicated on the packaging.

More current news is available on the UA.News Telegram channel Telegram.

If the object the user asks about is not in the frame, Gemini is expected to provide audio prompts to help point the camera correctly. The feature is also available through Google TalkBack, and on devices running Android 9 and later, it can be added to accessibility shortcuts in settings.

Feature limitations

Google warns against using Guided Vision for navigation, safe movement, or obstacle detection. The company also emphasizes that the tool should not replace a cane or other mobility aids. The Verge compares the new capability with the VoiceOver Live Recognition feature that Apple added to the iPhone and Vision Pro.