Emotion Classification Representation Method Based on Multimodal Hierarchical Feature Mapping and Fusion

With the development of mobile internet and 5G technology, social media platforms have rapidly evolved, enabling users to share opinions and express demands online. In this context, single-modal information representation is insufficient to fully capture the richness of internet content. Therefore, this paper proposes a multi-modal hierarchical feature mapping and fusion representation method (MHFMFR). This method combines the text model RoBERTa and the image model DenseNet, effectively mapping and fusing multi-modal data through a feature reuse strategy, thus improving the accuracy of sentiment classification. Experiments demonstrate that this method outperforms existing baseline models on the Weibo sentiment and MVSA-Multiple datasets.

Authors

Publication Details

Published
2024-09-20
DOI
https://doi.org/10.1109/itnec60942.2024.10733322
Primary Topic
Advanced Computing and Algorithms
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Emotion Classification Representation Method Based on Multimodal Hierarchical Feature Mapping and Fusion

Hao Pang, Zhihui Lai, Jingyi Huang, Yuming Sun
Advanced Computing and Algorithms
article

Emotion Classification Representation Method Based on Multimodal Hierarchical Feature Mapping and Fusion

Hao Pang, Zhihui Lai, Jingyi Huang, Yuming Sun
article en

Abstract

With the development of mobile internet and 5G technology, social media platforms have rapidly evolved, enabling users to share opinions and express demands online. In this context, single-modal information representation is insufficient to fully capture the richness of internet content. Therefore, this paper proposes a multi-modal hierarchical feature mapping and fusion representation method (MHFMFR). This method combines the text model RoBERTa and the image model DenseNet, effectively mapping and fusing multi-modal data through a feature reuse strategy, thus improving the accuracy of sentiment classification. Experiments demonstrate that this method outperforms existing baseline models on the Weibo sentiment and MVSA-Multiple datasets.

Openalex Percentile: Top 68%
Advanced Computing and Algorithms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.