Multisensory learning in XR

Purpose and goal

The purpose of this project is to investigate how multisensory feedback that provides visual, auditory and tactile information can be integrated into XR learning environments together with AI. More specifically, the purpose is to investigate how AI together with haptics and sonification in a learning environment can affect learning, the ability to work in groups and perceived sense of presence. The goal of the project is to explore how these environments can be used in real educational settings.

Expected effects and result

The potential pedagogical benefits of haptics and sonification will be explored, as well as how AI support in multi-user situations should be designed for collaboration and distance learning. To explore how these areas can be integrated, demonstrators will be developed and tested in this project. The results of the project will be implemented through an educational offering by project partners, reaching schools and other customers.

Planned approach and implementation

Evaluations will be conducted in real-world educational settings to explore how multisensory feedback in XR learning environments affects how people behave and perceive collaborative situations and how it impacts learning and performance. In conjunction with these evaluations, the aim is to estimate the necessary network capacity requirements to enable this type of multisensory learning in multi-user XR with AI, in future communications over 5G and 6G networks.