Review of Multimodal Sentiment Analysis Techniques

By integrating multimodal data such as text, image, audio and video, the multimodal emotion analysis technology has significantly improved the accuracy and robustness of emotion recognition, and has become a research hotspot in the field of artificial intelligence. This paper summarizes the research background, main research content and application of multimodal emotion analysis, and discusses the future development trend. This paper emphasizes the importance of emotion analysis in understanding user intention, improving user experience and optimizing decision support system, and points out the limitations of traditional unimodal emotion analysis, and leads to the necessity of multimodal emotion analysis. It systematically reviews the key technologies and methods of multimodal emotion analysis, including data fusion strategies, deep learning models, attention mechanisms, and cross-modal association learning, and analyzes the challenges in current research, such as data set imbalance, inter-modal inconsistency, and real-time requirements. This paper provides a comprehensive research idea for subsequent researchers, including constructing high-quality datasets, optimizing algorithms, expanding application scenarios, strengthening interdisciplinary cooperation, and emphasizing ethics and privacy protection, to promote the further development of multimodal sentiment analysis technology in the field of artificial intelligence. With the improvement of computing power and the innovation of algorithms, multimodal emotion analysis technology will be even more important in the field of artificial intelligence in the future.

Authors

Institutions

Publication Details

Journal
Applied and Computational Engineering
Published
2024-12-26
DOI
https://doi.org/10.54254/2755-2721/2025.18747
Citations
2
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.69
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Review of Multimodal Sentiment Analysis Techniques

Zhangui Tang
2 citations
Applied and Computational Engineering
Sentiment Analysis and Opinion Mining
0.69
article

Review of Multimodal Sentiment Analysis Techniques

Zhangui Tang
article en
2 citations

Abstract

By integrating multimodal data such as text, image, audio and video, the multimodal emotion analysis technology has significantly improved the accuracy and robustness of emotion recognition, and has become a research hotspot in the field of artificial intelligence. This paper summarizes the research background, main research content and application of multimodal emotion analysis, and discusses the future development trend. This paper emphasizes the importance of emotion analysis in understanding user intention, improving user experience and optimizing decision support system, and points out the limitations of traditional unimodal emotion analysis, and leads to the necessity of multimodal emotion analysis. It systematically reviews the key technologies and methods of multimodal emotion analysis, including data fusion strategies, deep learning models, attention mechanisms, and cross-modal association learning, and analyzes the challenges in current research, such as data set imbalance, inter-modal inconsistency, and real-time requirements. This paper provides a comprehensive research idea for subsequent researchers, including constructing high-quality datasets, optimizing algorithms, expanding application scenarios, strengthening interdisciplinary cooperation, and emphasizing ethics and privacy protection, to promote the further development of multimodal sentiment analysis technology in the field of artificial intelligence. With the improvement of computing power and the innovation of algorithms, multimodal emotion analysis technology will be even more important in the field of artificial intelligence in the future.

Applied and Computational EngineeringVol. 120(1)
University of Science and Technology Beijing (CN)
Partnerships for the goals
Openalex Percentile: Top 22%
Sentiment Analysis and Opinion Mining
0.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.