Home / Technology / Google's AI Reads the World Aloud
Google's AI Reads the World Aloud
2 Oct
Summary
- AI provides real-time audio descriptions via phone camera.
- Feature assists blind, low-vision users, and others.
- Users can ask follow-up questions for more detail.
Guided Vision, a new AI-powered feature, has launched on Gemini Live for compatible Android devices. This technology provides real-time audio descriptions of the environment captured by your phone's camera. By enabling camera sharing, users can leverage Google's AI for tasks such as reading small text, understanding surroundings, locating objects, and identifying specific details.
This feature is particularly beneficial for individuals who are blind or have low vision. It functions similarly to Apple's VoiceOver Live Recognition. Beyond the Gemini app, Guided Vision is accessible through Google TalkBack and can be set up as an accessibility shortcut on Android 9 and above.
Users can engage further by asking Gemini follow-up questions about the described objects or scenes. For instance, it can read expiration dates or provide more information. Google has stated that Gemini will offer audio cues to help users properly frame their camera shots. However, the company cautions against relying on Guided Vision for navigation or safety guidance.
