With the upcoming release of Apple Vision Pro in early 2024, developers are exploring the capabilities of this spatial computer through the visionOS DevKit. One intriguing feature, shared by developer Steve Troughton-Smith, is the ability to place a visionOS window flat on a desk, enabling a more immersive and realistic user experience for various tasks such as playing music or typing on a virtual keyboard.
Interestingly, Apple had filed a patent in 2016, which was later granted in 2020, that describes this technology employed by the Apple Vision Pro. Although the original patent link is no longer accessible, AppleInsider previously covered its contents. The patent discusses the natural human interaction of touch and the widespread use of touch screens in devices like smartphones and tablets. Apple’s scientists explored the idea of using cameras to track finger movements and enable touch interactions—a concept now realized with Vision Pro.
By combining the insights from the patent with Troughton-Smith’s visionOS preview, it becomes evident that interacting with virtual objects on any surface can be incredibly lifelike and natural. The app seamlessly integrates with the surface, creating a sensation akin to approaching a physical object, such as a book on a table or a keyboard on a desk.
While the official release of Apple Vision Pro is still a few months away, the availability of the SDK and the visionOS beta offer developers and users an opportunity to delve deeper into Apple’s first spatial computer. As we await its launch, we can anticipate further discoveries and insights into the groundbreaking capabilities of this innovative technology.
