Unlocking the Power of Emotions: Enhancing Personality Trait Recognition Through Utilization of Emotional Cues
Personality trait recognition holds significant importance in psychology and affective computing, due to its role in understanding human behavior and emotions. However, existing approaches often treat personality and emotion as separate tasks, overlooking the potential of leveraging emotion-related cues in the data for personality modeling. To address this limitation, we propose a multimodal multitask learning framework that utilizes emotional cues to enhance personality trait recognition. Experimental results demonstrate that our proposed framework outperforms state-of-the-art methods on the First Impression benchmark in text-audio bi-modality, showcasing the effectiveness of harnessing emotional cues for personality modeling.
Authors
- Xiaoying Xu (ORCID: https://orcid.org/0000-0001-5149-9487)
- Hao Lin (ORCID: https://orcid.org/0000-0002-1921-3036)
- Ruibo Fu (ORCID: https://orcid.org/0000-0001-9598-1881)
- Yongwei Li (ORCID: https://orcid.org/0000-0001-7799-366X)
- Yukun Liu (ORCID: https://orcid.org/0000-0003-1470-9961)
- Le Wang
- Guanjun Li
- Xuefei Liu (ORCID: https://orcid.org/0000-0002-1843-6107)
- Jizhou Cui (ORCID: https://orcid.org/0009-0002-9253-6461)
- Zhengqi Wen
- Jianhua Tao (ORCID: https://orcid.org/0000-0002-9344-6428)
Institutions
- Chinese Academy of Sciences (CN)
- ShanghaiTech University (CN)
- Tsinghua University (CN)
Publication Details
- Published
- 2024-11-07
- DOI
- https://doi.org/10.1109/iscslp63861.2024.10799975
- Primary Topic
- Personality Traits and Psychology
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China