Hand interaction in XR

Important results from the project

Yes, we engaged with more XR manufacturers and enterprise users than expected, gained insights into competitors, and identified next steps for hand tracking. Additionally, we built connections within the Swedish XR ecosystem, fostering collaboration. Key outcomes include potential applications with Volvo using Varjo’s XR4 headset, with Karolinska Institute in various fields, and discovering how NVIDIA Omniverse can improve our internal processes for creating training data more efficiently.

Expected long term effects

We expect to create a transformative open platform for hand interaction, lowering barriers for XR adoption by enabling smartphone users to explore XR and providing manufacturers—big and small—with advanced hand-tracking capabilities without requiring high computational power. In addition, it aims to develop a cutting-edge data generation engine for flexible, customizable software that meets client expectations with minimal adjustment time, driving innovation and accessibility in the XR industry.

Approach and implementation

The project activities were well-chosen but faced challenges due to the January deadline and limited partner responses. Despite this, we adhered to the timeline. External factors included the Android XR announcement and the overlap with Christmas and CES, affecting partner availability. The unexpected launch of the Android XR closed platform was significant. Overall, the collaboration succeeded, reflecting strong teamwork and alignment with goals.