Transferring Personality Knowledge to Multimodal Sentiment Analysis

Multimodal sentiment analysis systems have achieved remarkable success. However, significant challenges persist in tailoring sentiment analysis to individualized needs. Recognizing the pivotal role of personality traits in shaping emotional expression-where distinct personalities manifest emotions with varying styles and intensities-we introduce a novel enhancement to MSA. Our approach integrates personality traits into the sentiment recognition framework, refining its ability to discern nuanced emotional variances among individuals. This paper presents the TPK (Transferring Personality Knowledge) framework, is a pioneering solution designed to bolster the personalization and precision of sentiment analysis. The TPK frame-work is distinguished by its dual-pronged strategy: firstly, the seamless transfer of personality knowledge to enrich sentiment learning, thereby capturing personalized emotional signals; secondly, the synergistic fusion of multimodal data to amplify the depth of emotional expression. We substantiate the TPK framework's efficacy through rigorous experimentation on two renowned public datasets.

Authors

Institutions

Publication Details

Published
2024-11-07
DOI
https://doi.org/10.1109/iscslp63861.2024.10800671
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Transferring Personality Knowledge to Multimodal Sentiment Analysis

Cunhang Fan, Heng Xie, Hao Lin, Ruibo Fu et al.
Sentiment Analysis and Opinion Mining
article

Transferring Personality Knowledge to Multimodal Sentiment Analysis

Cunhang Fan, Heng Xie, Hao Lin, Ruibo Fu, Le Yi Wang, Cong Cai, Kang Zhu, Zhao Lv, Guanjun Li, Xuefei Liu, Zhengqi Wen, Jianhua Tao
article en

Abstract

Multimodal sentiment analysis systems have achieved remarkable success. However, significant challenges persist in tailoring sentiment analysis to individualized needs. Recognizing the pivotal role of personality traits in shaping emotional expression-where distinct personalities manifest emotions with varying styles and intensities-we introduce a novel enhancement to MSA. Our approach integrates personality traits into the sentiment recognition framework, refining its ability to discern nuanced emotional variances among individuals. This paper presents the TPK (Transferring Personality Knowledge) framework, is a pioneering solution designed to bolster the personalization and precision of sentiment analysis. The TPK frame-work is distinguished by its dual-pronged strategy: firstly, the seamless transfer of personality knowledge to enrich sentiment learning, thereby capturing personalized emotional signals; secondly, the synergistic fusion of multimodal data to amplify the depth of emotional expression. We substantiate the TPK framework's efficacy through rigorous experimentation on two renowned public datasets.

Beijing Institute of Technology (CN), Anhui University (CN), Chinese Academy of Sciences (CN), Tsinghua University (CN)
Openalex Percentile: Top 78%
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.