Fusion Techniques and Contextual Integration in Multimodal Sentiment Analysis

Multimodal Sentiment Analysis (MSA) is concerned with the problem of inferring human emotion from blended textual, visual, and auditory signals, and modality fusion being a central bottleneck. This paper overviews the history of MSA fusion methods, ranging from basic averaging to sophisticated deep learning techniques such as cross-modal attention and Large Vision-Language Model integration. We present a new hierarchical sequence-to-sequence model, L2-MCTN, with cyclic consistency constraints to address temporal misalignment and modality incongruence. On the CMU-MOSI dataset, L2-MCTN attains a Mean Absolute Error (MAE) of 0.67 and 80.3% 7-class accuracy, outperforming models such as MulT and TFN with higher parameter efficiency. The work also touches upon current MSA issues, such as heterogeneity of data and computational requirements, and presents future directions toward explainable, efficient, and ethical systems.

Authors

Institutions

Publication Details

Published
2025-07-04
DOI
https://doi.org/10.1109/icctdc64446.2025.11158728
Citations
1
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fusion Techniques and Contextual Integration in Multimodal Sentiment Analysis

Tripti Sharma, Lav Upadhyay, Babita Tiwari, Lala Arnav Vatsal
1 citations
Sentiment Analysis and Opinion Mining
2.48
article

Fusion Techniques and Contextual Integration in Multimodal Sentiment Analysis

Tripti Sharma, Lav Upadhyay, Babita Tiwari, Lala Arnav Vatsal
article en
1 citations

Abstract

Multimodal Sentiment Analysis (MSA) is concerned with the problem of inferring human emotion from blended textual, visual, and auditory signals, and modality fusion being a central bottleneck. This paper overviews the history of MSA fusion methods, ranging from basic averaging to sophisticated deep learning techniques such as cross-modal attention and Large Vision-Language Model integration. We present a new hierarchical sequence-to-sequence model, L2-MCTN, with cyclic consistency constraints to address temporal misalignment and modality incongruence. On the CMU-MOSI dataset, L2-MCTN attains a Mean Absolute Error (MAE) of 0.67 and 80.3% 7-class accuracy, outperforming models such as MulT and TFN with higher parameter efficiency. The work also touches upon current MSA issues, such as heterogeneity of data and computational requirements, and presents future directions toward explainable, efficient, and ethical systems.

Maharaja Engineering College (IN), University of Rajasthan (IN)
Openalex Percentile: Top 8%
Sentiment Analysis and Opinion Mining
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.