The EMPATHIC project focuses on creating an emotionally expressive virtual coach for seniors, aiming to improve well-being and promote independent aging. This paper discusses the development and performance of the emotion expression recognition module of the virtual coach. The module utilizes various modalities including speech from audio, facial expressions, gaze, and head dynamics from video to recognize emotional states. The study includes users from Spain, France, and Norway, allowing for a cross-cultural comparison. Results show multimodal methods generally outperform others, confirming the informative power of the studied modalities for the emotional categories considered.
Publication date: 13 Nov 2023
Project Page: N/A
Paper: https://arxiv.org/pdf/2311.05567
