Fine-Grained Sentiment Analysis of Public Opinion Videos Based on Conformer and Multi-Layered Interaction Attention

With the rapid development of internet technologies and the widespread adoption of smart devices, social media platforms have become significant channels for information dissemination and public sentiment expression. In particular, new media formats such as short videos have shown a substantial impact on public opinion guidance and emotional transmission, making sentiment analysis of short video content highly meaningful. However, existing research has limitations in modality interactions, often employing weighted summation or self-attention mechanisms for deep fusion of extracted features. These approaches fail to fully account for the complex local dependencies and hierarchical structures among modalities. To address these issues, this paper proposes a fine-grained sentiment analysis model for public opinion videos based on Conformer and multi-layered interaction attention mechanisms, termed DW-MIACon. The model first utilizes DeBERTa, CLIP, and Wav2Vec models to extract features from text, images, and audio, respectively. Subsequently, the extracted multimodal features are fused using a Dynamic Weighted Multi-layered Interaction Attention (DW-MIA) mechanism, generating rich fusion feature representations. Finally, a Conformer model is employed to deeply integrate the fused features, capturing complex interactions and local dependencies between modalities. Experimental results demonstrate that the proposed model significantly outperforms existing approaches in multimodal sentiment recognition tasks, notably enhancing the accuracy of fine-grained sentiment classification and the ability to identify subtle emotional nuances.

Authors

Institutions

Publication Details

Journal
Journal of big data and computing.
Published
2024-09-01
DOI
https://doi.org/10.62517/jbdc.202401313
Primary Topic
Advanced Computing and Algorithms
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fine-Grained Sentiment Analysis of Public Opinion Videos Based on Conformer and Multi-Layered Interaction Attention

Zhengguang Gao, Lihong Zhang, Chaolong Liu
Journal of big data and computing.
Advanced Computing and Algorithms
article

Fine-Grained Sentiment Analysis of Public Opinion Videos Based on Conformer and Multi-Layered Interaction Attention

Zhengguang Gao, Lihong Zhang, Chaolong Liu
article en

Abstract

With the rapid development of internet technologies and the widespread adoption of smart devices, social media platforms have become significant channels for information dissemination and public sentiment expression. In particular, new media formats such as short videos have shown a substantial impact on public opinion guidance and emotional transmission, making sentiment analysis of short video content highly meaningful. However, existing research has limitations in modality interactions, often employing weighted summation or self-attention mechanisms for deep fusion of extracted features. These approaches fail to fully account for the complex local dependencies and hierarchical structures among modalities. To address these issues, this paper proposes a fine-grained sentiment analysis model for public opinion videos based on Conformer and multi-layered interaction attention mechanisms, termed DW-MIACon. The model first utilizes DeBERTa, CLIP, and Wav2Vec models to extract features from text, images, and audio, respectively. Subsequently, the extracted multimodal features are fused using a Dynamic Weighted Multi-layered Interaction Attention (DW-MIA) mechanism, generating rich fusion feature representations. Finally, a Conformer model is employed to deeply integrate the fused features, capturing complex interactions and local dependencies between modalities. Experimental results demonstrate that the proposed model significantly outperforms existing approaches in multimodal sentiment recognition tasks, notably enhancing the accuracy of fine-grained sentiment classification and the ability to identify subtle emotional nuances.

Journal of big data and computing.Vol. 2(3)
China People's Police University (CN)
Openalex Percentile: Top 49%
Advanced Computing and Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.