Home / Technology / Siri Sees All: Apple's Vision Pro Unleashes Visual Intelligence
Siri Sees All: Apple's Vision Pro Unleashes Visual Intelligence
12 Jun
Summary
- Vision Pro's Siri now uses visual intelligence to describe surroundings.
- It can identify real and virtual objects within the user's view.
- Users can turn panoramic photos into 3D wraparound backgrounds.

Apple's Vision Pro headset is set to feature a significantly enhanced Siri, leveraging advanced visual intelligence capabilities. This upgrade, previewed in a developer build, allows Siri to perceive and describe the user's surroundings in real-time.
During testing, Siri manifested as an interactive glowing orb. It could identify both physical objects like books and virtual elements such as simulated windows, demonstrating its ability to process mixed reality environments. This visual recognition follows a snap-and-respond pattern, similar to other AI-powered glasses.
Further enhancing the spatial computing experience, the Vision Pro now enables users to convert panoramic photos into dynamic 3D wraparound backgrounds. While still in early development, this feature allows personal photos to create immersive visual displays for the user's workspace.
These evolving assistive functions for the Vision Pro hint at future possibilities, potentially including more integrated AR glasses. The current iteration requires the $3,499 headset, but the underlying technology points towards broader applications in the future.