I_mBODYlab_logo

i_mBODY Lab

Interactive Multisensory Body-centred Experiences
at the Intersection of Neuroscience & Technology

The Possibilities of Natural Interaction in XR: A Hands-On Approach

Date: 2024-10-07, 13:00h-14:00h UTC+2 (CEST)

Speaker: Carlos Cortés, Grupo de Tratamiento de Imágenes, Universidad Politecnica de Madrid

Title: The Possibilities of Natural Interaction in XR: A Hands-On Approach

Abstract: 

This talk will present a comprehensive overview of natural interaction methods developed within the context of XR applications. The focus will be on hand-based interactions and the possibilities and challenges involved in creating a user-centric XR environment while meeting technical requirements.

The presentation will delve into the Epsilon project, a joint initiative between Nokia and the UPM, which aimed to enable XR training for construction measurements using egocentric segmentation and natural interfaces. The challenges and requirements of XR applications in the construction domain will be discussed, along with the results of two QoE experiments conducted within the project.

In addition, the Incluverso Project—a collaboration between Nokia, Fundación Juan XXIII, and UPM—will be presented. This initiative uses XR technology to adapt behavioral and cognitive therapies for individuals with intellectual disabilities. The presentation will cover the project’s progress and initial findings related to therapy outcomes, including the development of a comprehensive tool for monitoring and implementing XR therapy for bathmophobia treatment, as well as a tool designed to adapt cognitive training tasks to an XR environment.

Finally, the talk will discuss the project’s future work, including the development of a training tool that enables users to participate in and follow a cooking lesson using XR technology. The potential practical applications of this tool and its impact on learning, engagement, and independence for individuals with intellectual disabilities will be highlighted.

Biography:

Carlos Cortés is a postdoctoral researcher at the Universidad Politécnica de Madrid. His research focuses on natural interfaces, particularly hand-based interactions, and how they impact the user experience in Social XR settings, especially considering factors like delay.