Fluid-Xpress: Emotion-Aware Dual-Loop Framework for Empathic Facial Reaction in HRI
Large Language Model (LLM)-driven social robots face two key challenges: inference latency creates unnatural silences during which an expressively static robot appears disengaged, and LLMs rarely account for the user's facial affect as a continuous evolving process. We present Fluid-Xpress, an emotion-aware dual-loop framework for empathic facial reactions in human-robot interaction. The framework features: (1) a Macro-Micro dual-loop architecture that decouples real-time non-verbal feedback from LLM verbal processing, enabling continuous affective backchanneling during inference latency; (2) a Temporal Affective Engine using metrics such as MSSD to capture emotional dynamics and detect complex states like cognitive overload and masked emotions; and (3) a Risk-Adaptive Strategy that prioritizes immediate intervention during high-arousal states. A pilot study (N=8) showed that Fluid-Xpress significantly improved arousal stability (p < .05), mood improvement (p < .05), expression awareness (p < .01), and perceived empathy (p < .05) compared to baseline, providing preliminary support for emotion-aware non-verbal feedback in embodied social robots.
Authors
- Zhegong Shangguan
- Ruidong Ma (ORCID: https://orcid.org/0000-0002-8035-5746)
- Yufei Wang (ORCID: https://orcid.org/0000-0002-2317-9010)
- Chen Kang
- Xiaochi Cai
- Madina Alitai
- Angelo Cangelosi
Institutions
- Beijing Language and Culture University (CN)
- Pennsylvania State University (US)
- University of Manchester (GB)
- Sheffield Hallam University (GB)
Publication Details
- Published
- 2026-03-12
- DOI
- https://doi.org/10.1145/3776734.3794429
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00