Application and optimization of deep convolutional neural networks in multimodal emotion recognition

With the development of artificial intelligence, emotion recognition has become a hot topic in the field of human-computer interaction. This paper focuses on the application and optimization of deep convolutional neural networks (CNNs) in multimodal emotion recognition. Multimodal emotion recognition involves analyzing data from different sourcessuch as voice, facial expressions, and textto more accurately identify and interpret human emotional states. This paper first reviews the basic theories and methods of multimodal data processing, then details the structure and function of deep convolutional neural networks, particularly their advantages in handling various types of data. By innovating and optimizing network structures, loss functions, and training strategies, we have improved the model's accuracy in emotion recognition. Ultimately, experimental results show that the optimized CNN model demonstrates superior performance in multimodal emotion recognition tasks.

Authors

Institutions

Publication Details

Journal
Advances in Engineering Innovation
Published
2024-12-20
DOI
https://doi.org/10.54254/2977-3903/2024.19130
Citations
1
Primary Topic
Educational Technology and Pedagogy
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Application and optimization of deep convolutional neural networks in multimodal emotion recognition

Qunli Xie
1 citations
Advances in Engineering Innovation
Educational Technology and Pedagogy
0.35
article

Application and optimization of deep convolutional neural networks in multimodal emotion recognition

Qunli Xie
article en
1 citations

Abstract

With the development of artificial intelligence, emotion recognition has become a hot topic in the field of human-computer interaction. This paper focuses on the application and optimization of deep convolutional neural networks (CNNs) in multimodal emotion recognition. Multimodal emotion recognition involves analyzing data from different sourcessuch as voice, facial expressions, and textto more accurately identify and interpret human emotional states. This paper first reviews the basic theories and methods of multimodal data processing, then details the structure and function of deep convolutional neural networks, particularly their advantages in handling various types of data. By innovating and optimizing network structures, loss functions, and training strategies, we have improved the model's accuracy in emotion recognition. Ultimately, experimental results show that the optimized CNN model demonstrates superior performance in multimodal emotion recognition tasks.

Advances in Engineering InnovationVol. 14(1)
Software Engineering Institute (US), Institute of Software (CN), Software Engineering Institute of Guangzhou
Openalex Percentile: Top 30%
Educational Technology and Pedagogy
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Application and optimization of deep convolutional neural networks in multimodal emotion recognition — Qunli Xie · Advances in Engineering Innovation (2024) | TGRS Research Map | TGRS