Multilingual Emotion Profiling of Large Language Models Through Literary Texts and Persona Conditioning
This paper examines whether multilingual prompt-and-text conditions materially alter large language model (LLM) emotion evaluation rather than merely rephrasing the same task. Using OpenRouter as a unified inference layer, we evaluated six contemporary LLMs under three full-language conditions (Japanese, English, and Traditional Chinese), three literary texts, four personas, and three repeated API calls per condition. Each completion rated four emotional dimensions — Interesting, Surprise, Sadness, and Anger — and provided a brief rationale. The design comprised 648 planned evaluations (6 models × 3 languages × 3 texts × 4 personas × 3 trials). The final combined dataset contained 648 valid records, comprising 631 original records and 17 replacement records obtained under a repair amendment registered after the main run and before the patch run. Descriptive summaries and preregistered ordinary least squares analyses with HC3 robust standard errors showed that text content was a major driver of scores, especially for Sadness and Anger. Simultaneously, model-language interactions were significant for all four emotions, indicating that the effect of the language condition varied substantially across models. English yielded the highest mean Interesting, Surprise, and Sadness scores, whereas Japanese yielded the highest mean Anger score. However, these aggregate patterns mask the strong model-specific contrasts. The findings show that multilingual literary evaluation is shaped by both the text itself and the model processing of its translation. This study contributes a multilingual literary emotion benchmark, a preregistered and repair-aware evaluation pipeline, and evidence that multilingual conditions are substantive experimental factors for LLM emotion profiling.
Authors
- Naruki Shirahama (ORCID: https://orcid.org/0000-0002-6512-6769)
- Naofumi Nakaya (ORCID: https://orcid.org/0009-0006-4926-3567)
- Yuma Yoshimoto
- Satoshi Watanabe (ORCID: https://orcid.org/0009-0003-2795-1623)
Institutions
- Shimonoseki City University (JP)
- National Institute of Technology (JP)
- Juntendo University Urayasu Hospital (JP)
- Shizuoka Institute of Science and Technology (JP)
Publication Details
- Journal
- Journal of Advanced Computational Intelligence and Intelligent Informatics
- Published
- 2026-11-20
- DOI
- https://doi.org/10.20965/jaciii.2026.p1866
- Primary Topic
- Sentiment Analysis and Opinion Mining
- Type
- article
- Field-Weighted Citation Impact
- 0.00