An Emotion-Dependent Dissociation in Emoji Communication: Neurophysiological and Behavioral Evidence
Emojis are a major medium of emotional expression in digital communication, yet how emoji type and emotion jointly shape emotional recognition remains unclear. Using a within-subjects 5 × 4 design (five emotions, four emoji types; N = 20), this study combined fNIRS, eye-tracking, and questionnaire measures to assess prefrontal activity, visual attention, and perceived communication effectiveness (PCE). Emotion category drove prefrontal HbO responses across five significant prefrontal ROIs, whereas emoji type showed no significant effect. Eye-tracking revealed an emotion × emoji type interaction on pupil diameter, with larger pupils for realistic than graphic-con stimuli. PCE ratings also showed significant interaction effects: ani-con and graphic-con generally outperformed realistic across most emotions, whereas fear showed no reliable type advantage. These findings are consistent with an emotion-dependent, conditional dissociation between arousal-related visual attention and perceived communicative usefulness in emoji communication and suggest tentative implications for emoji design in digital contexts.
Authors
- 여상아
- Chunghun Ha (ORCID: https://orcid.org/0000-0002-4222-2555)
- Jaechang Cha
- Seongdae Kim (ORCID: https://orcid.org/0000-0002-1525-0091)
Institutions
- Sejong University (KR)
- Hong Kong Metropolitan University (HK)
- Hongik University (KR)
Publication Details
- Journal
- International Journal of Human-Computer Interaction
- Published
- 2026-09-18
- DOI
- https://doi.org/10.1080/10447318.2026.2728934
- Primary Topic
- Digital Communication and Language
- Type
- article
- Field-Weighted Citation Impact
- 0.00