Apple has officially unveiled its highly anticipated VR headset, the Vision Pro, at this year’s WWDC 2023 event, putting an end to years of rumors and speculation. The Vision Pro showcases impressive capabilities such as 4K resolution output from each miniature display and the ability to generate a “digital persona” through facial scanning. However, according to Mike Rockwell, VP of the Technology Development Group at Apple, the true power behind these advancements lies in the newly introduced operating system called visionOS, which is specifically designed for “spatial computing.”
Built upon the foundational elements of macOS and iOS, visionOS brings unique features tailored to enhance the virtual reality experience. One notable feature is the Foveated Renderer, similar to the one found in PSVR 2, which optimizes visual fidelity by sharpening the user’s focal point while blurring the peripheral vision.
Another standout feature of visionOS is its “multi-app 3D engine,” enabling simultaneous operation of different applications. While the overall appearance of visionOS resembles that of other virtual reality platforms, with floating windows in front of the user, its true strengths lie in individual use cases.
With visionOS, users can send and display 3D image files via Messages, allowing models to be viewed from various angles. The system also adapts to the ambient lighting, providing accurate shadows that match the user’s environment. This feature aids in understanding scale and distance. Additionally, professionals can customize their workspace by arranging apps to their liking.
Control within visionOS primarily relies on hand gestures, eye movements, and voice commands. However, users also have the option to connect Bluetooth peripherals, such as the Magic Keyboard, for a more physical interaction.
At launch, visionOS will natively support third-party apps, including popular ones like Adobe Lightroom, Microsoft Teams, and Zoom. It remains uncertain if applications like Photoshop will be available upon release.
Furthermore, visionOS will encompass educational apps, featuring specialized software for medical and engineering purposes. For instance, a medical app allows users to examine detailed renders of the human body, while an engineering app facilitates visualizing complex physics phenomena.
Although visionOS appears to be an enterprise-oriented tool reminiscent of Microsoft HoloLens, Apple has also incorporated impressive entertainment features. At launch, the Vision Pro will support Disney Plus and over 100 games through Apple Arcade. Users can expand the virtual screen to cinematic proportions, immerse themselves in 3D movies, and even replace the background environment with various settings.
While the gaming aspect was not extensively showcased during the keynote, it is known that visionOS supports gamepads such as the PS5 DualSense controller. Apple’s intention seems to be providing a holistic experience rather than positioning the headset as a dedicated gaming computer. A Star Wars VR adventure set in The Mandalorian universe was revealed, but action-packed experiences like lightsaber duels were not prominently featured.
In terms of software development, Apple announced that visionOS will support the Unity game engine, potentially attracting developers to create video games for the platform. However, the reception from developers remains uncertain given Apple’s track record in the gaming industry.
With WWDC 2023 concluded, Apple has showcased an array of exciting announcements, from the introduction of macOS Sonoma to the unveiling of the new Mac Pro. Among the highlights, the Vision Pro and visionOS stand out as groundbreaking advancements in the realm of virtual reality.
