Emotion Recognition Using a Hybrid Model of Transformer and CNN-LSTM for Improved Performance

Emotion recognition is a crucial aspect of AI technology that fills in the gap of human-machine interaction, allowing systems to react to human emotions effectively. The traditional models often struggle with precision and robustness when it comes to noisy data along with the complexity of analyzing human emotions. This paper proposes a hybrid model architecture by combining the Transformer model and CNN-LSTMs in order to maximize emotion recognition. The Transformer module captures input data's long-range dependencies, whereas the CNN-LSTM architecture extracts spatial and temporal features from voice signals, with potential extension to multimodal inputs such as facial expressions and physiological data. This work shows the capability of advanced hybrid architecture in developing emotionally intelligent systems in healthcare, education, customer service, and other applications. The findings pave the way for future work on multimodal data integration and generalization in complicated environments.

Authors

Institutions

Publication Details

Published
2025-03-07
DOI
https://doi.org/10.1109/icdt63985.2025.10986535
Citations
9
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
19.06
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Emotion Recognition Using a Hybrid Model of Transformer and CNN-LSTM for Improved Performance

Palak Palak, S. L. CHADHA, Palvi Sharma, Venkata Suresh Babu Chilluri
9 citations
Emotion and Mood Recognition
19.06
article

Emotion Recognition Using a Hybrid Model of Transformer and CNN-LSTM for Improved Performance

Palak Palak, S. L. CHADHA, Palvi Sharma, Venkata Suresh Babu Chilluri
article en
9 citations

Abstract

Emotion recognition is a crucial aspect of AI technology that fills in the gap of human-machine interaction, allowing systems to react to human emotions effectively. The traditional models often struggle with precision and robustness when it comes to noisy data along with the complexity of analyzing human emotions. This paper proposes a hybrid model architecture by combining the Transformer model and CNN-LSTMs in order to maximize emotion recognition. The Transformer module captures input data's long-range dependencies, whereas the CNN-LSTM architecture extracts spatial and temporal features from voice signals, with potential extension to multimodal inputs such as facial expressions and physiological data. This work shows the capability of advanced hybrid architecture in developing emotionally intelligent systems in healthcare, education, customer service, and other applications. The findings pave the way for future work on multimodal data integration and generalization in complicated environments.

Mountain View College (US)
Affordable and clean energy
Openalex Percentile: Top 1%
Emotion and Mood Recognition
19.06
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.