Emotion Classification Representation Method Based on Multimodal Hierarchical Feature Mapping and Fusion
With the development of mobile internet and 5G technology, social media platforms have rapidly evolved, enabling users to share opinions and express demands online. In this context, single-modal information representation is insufficient to fully capture the richness of internet content. Therefore, this paper proposes a multi-modal hierarchical feature mapping and fusion representation method (MHFMFR). This method combines the text model RoBERTa and the image model DenseNet, effectively mapping and fusing multi-modal data through a feature reuse strategy, thus improving the accuracy of sentiment classification. Experiments demonstrate that this method outperforms existing baseline models on the Weibo sentiment and MVSA-Multiple datasets.
Authors
- Hao Pang (ORCID: https://orcid.org/0000-0002-7516-3889)
- Zhihui Lai (ORCID: https://orcid.org/0000-0002-4388-3080)
- Jingyi Huang (ORCID: https://orcid.org/0000-0003-4555-0797)
- Yuming Sun
Publication Details
- Published
- 2024-09-20
- DOI
- https://doi.org/10.1109/itnec60942.2024.10733322
- Primary Topic
- Advanced Computing and Algorithms
- Type
- article
- Field-Weighted Citation Impact
- 0.00