An adaptive Extended Reality (XR) framework that senses user emotions in real time using Meta Quest 3 to personalize virtual environments, pacing, and avatar dialogues.
Developed in collaboration with Sapienza University of Rome, Emotional Tracking is an R&D initiative focused on building an adaptive Extended Reality (XR) framework capable of sensing and interpreting user emotions in real time. Leveraging Meta Quest 3 headsets and conversational avatars, the system continuously analyzes interaction signals—including speech, behavior, and context—to estimate affective states.
Using this emotional insight, the framework dynamically adjusts the virtual experience: altering environmental aesthetics, modulating interaction pacing, and adapting the avatar’s dialogue to respond empathetically to how the user feels in the moment.
The primary goal of this initiative is to provide a robust, developer-ready foundation for a new generation of truly personalized, intelligent, and emotionally aware mixed-reality applications.
