Multimodal Affective Computing in Employee Care Based on the Multi-Fusion Residual Memory Model

The application of artificial intelligence in the field of affective computing has been expanding, especially in enterprise employee care, and the multimodal data fusion model has become the key to improve the accuracy of emotion recognition. The study proposes a multimodal residual memory network model, which adopts multimodal data inputs such as visual and physiological signals, combines gated cyclic units for temporal modelling, and uses the affective intensity attention mechanism for feature fusion, as well as a bi-directional long and short-term memory network for time-step level affective modelling, and finally adopts a cross-view learning module for classification. The experimental results show that the model achieves an emotion recognition accuracy of 91% with 500 data samples, and the root mean square error is reduced to 0.1, which is better than the other compared models. For the five emotion categories, the model has an average recognition accuracy of 71%, which is an improvement of about 12% compared to the model based on the multifactor hierarchical framework. The results show that the method has strong potential for application in the field of multimodal affective computing, and can provide more accurate emotion recognition support for employee care systems.

Authors

Institutions

Publication Details

Published
2025-04-18
DOI
https://doi.org/10.1145/3744464.3744502
Primary Topic
Mental Health via Writing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal Affective Computing in Employee Care Based on the Multi-Fusion Residual Memory Model

Xiaorong Jiang
Mental Health via Writing
article

Multimodal Affective Computing in Employee Care Based on the Multi-Fusion Residual Memory Model

Xiaorong Jiang
article en

Abstract

The application of artificial intelligence in the field of affective computing has been expanding, especially in enterprise employee care, and the multimodal data fusion model has become the key to improve the accuracy of emotion recognition. The study proposes a multimodal residual memory network model, which adopts multimodal data inputs such as visual and physiological signals, combines gated cyclic units for temporal modelling, and uses the affective intensity attention mechanism for feature fusion, as well as a bi-directional long and short-term memory network for time-step level affective modelling, and finally adopts a cross-view learning module for classification. The experimental results show that the model achieves an emotion recognition accuracy of 91% with 500 data samples, and the root mean square error is reduced to 0.1, which is better than the other compared models. For the five emotion categories, the model has an average recognition accuracy of 71%, which is an improvement of about 12% compared to the model based on the multifactor hierarchical framework. The results show that the method has strong potential for application in the field of multimodal affective computing, and can provide more accurate emotion recognition support for employee care systems.

Xi'an University of Technology (CN)
Openalex Percentile: Top 81%
Mental Health via Writing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.