Google has begun rolling out Guided Vision, a Gemini Live feature for Android that provides real-time audio descriptions of whatever a user points their phone camera at. The tool is designed for people who are blind, have low vision, or need help in specific situations, and it can read fine print, describe surroundings, and identify objects.
Users can access Guided Vision through the Gemini app, Google TalkBack, or an accessibility shortcut in Android Settings on devices running Android 9 and above. Google says Gemini will also give audio cues to help users line up the camera if an object is not in frame, and users can ask follow-up questions, such as asking for an expiration date on an item it helped find.
Google cautions that Guided Vision should not be relied on for navigation, safe-travel guidance, or obstacle detection, and that it is not a replacement for a cane or mobility aid. The feature is similar to Apple's VoiceOver Live Recognition on iPhone and Vision Pro, though Google's version is tied to Gemini Live and Android.