Apple’s highly anticipated Vision Pro headset is set to revolutionize the world of spatial computing. While the device’s immersive entertainment capabilities have garnered significant attention, it’s potential for productivity and practical applications have caught the interest of many users. One standout app, Visual Search, developed by Apple, promises to redefine how users interact with the world around them, rivalling Google Lens in its functionality and convenience.
It looks like 'Visual Search' is part of Spotlight instead of the camera. I wish Apple had shown off this feature and ARKit during the keynote. Related accessibility feature: ""Describe Passthrough" requires Image Captions to be enabled in Settings Accessibility > VoiceOver." https://t.co/e0GPqjvECc
— Steve Moser (@SteveMoser) June 22, 2023
Visual Search Unveiled:
Discovered within the visionOS SDK by developer Steve Moser, Visual Search introduces an array of exciting features. Users will be able to effortlessly obtain more information about real-life objects simply by looking at them. This innovative app allows for the detection and interaction with text, including the ability to copy and paste printed text and translate it into 17 different languages. Furthermore, Visual Search enables users to load web addresses they encounter in the physical world and convert units from one system to another.
Apple’s Advantages:
While some similarities exist between Visual Search and Google Lens, Apple already possesses similar capabilities within its iOS ecosystem. iPhone users are familiar with features like Visual Lookup, which provides details about objects, Live Text for text interaction and translation, and QR code scanning. Visual Search will integrate these functionalities into a single app, seamlessly incorporating them into Vision Pro’s Spotlight search feature.
The Power of Spatial Computing:
What sets Visual Search apart is its compatibility with Vision Pro’s unique spatial computing capabilities. Users can interact with real-life objects and text by simply looking at them and utilizing touch controls. When combined with voice control and the potential integration of advanced AI features like ChatGPT, Visual Search has the potential to significantly enhance search experiences, making it one of the most indispensable apps on the Vision Pro.
The Future of Vision Pro:
As Apple continues to develop and refine its first-generation Vision Pro headset, the company is investing in killer app ideas to ensure its success. Visual Search represents a powerful tool that showcases the device’s spatial computing potential. With the ability to seamlessly merge real-world information with digital interactions, Visual Search opens up a world of possibilities for productivity, information retrieval, and practical use cases.
Apple’s Vision Pro is poised to revolutionize the spatial computing landscape, and Visual Search emerges as a standout app with its impressive capabilities. By harnessing the power of spatial computing, incorporating existing iOS features, and providing an intuitive and seamless user experience, Visual Search has the potential to become a game-changer in the realm of search and information retrieval. As users eagerly await the availability of the Vision Pro, the inclusion of Visual Search signals a promising future for immersive productivity experiences.
