Multilingual Emotion Profiling of Large Language Models Through Literary Texts and Persona Conditioning

This paper examines whether multilingual prompt-and-text conditions materially alter large language model (LLM) emotion evaluation rather than merely rephrasing the same task. Using OpenRouter as a unified inference layer, we evaluated six contemporary LLMs under three full-language conditions (Japanese, English, and Traditional Chinese), three literary texts, four personas, and three repeated API calls per condition. Each completion rated four emotional dimensions — Interesting, Surprise, Sadness, and Anger — and provided a brief rationale. The design comprised 648 planned evaluations (6 models × 3 languages × 3 texts × 4 personas × 3 trials). The final combined dataset contained 648 valid records, comprising 631 original records and 17 replacement records obtained under a repair amendment registered after the main run and before the patch run. Descriptive summaries and preregistered ordinary least squares analyses with HC3 robust standard errors showed that text content was a major driver of scores, especially for Sadness and Anger. Simultaneously, model-language interactions were significant for all four emotions, indicating that the effect of the language condition varied substantially across models. English yielded the highest mean Interesting, Surprise, and Sadness scores, whereas Japanese yielded the highest mean Anger score. However, these aggregate patterns mask the strong model-specific contrasts. The findings show that multilingual literary evaluation is shaped by both the text itself and the model processing of its translation. This study contributes a multilingual literary emotion benchmark, a preregistered and repair-aware evaluation pipeline, and evidence that multilingual conditions are substantive experimental factors for LLM emotion profiling.

Authors

Institutions

Publication Details

Journal
Journal of Advanced Computational Intelligence and Intelligent Informatics
Published
2026-11-20
DOI
https://doi.org/10.20965/jaciii.2026.p1866
Primary Topic
Sentiment Analysis and Opinion Mining
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Multilingual Emotion Profiling of Large Language Models Through Literary Texts and Persona Conditioning

Naruki Shirahama, Naofumi Nakaya, Yuma Yoshimoto, Satoshi Watanabe
Journal of Advanced Computational Intelligence and Intelligent Informatics
Sentiment Analysis and Opinion Mining
article

Multilingual Emotion Profiling of Large Language Models Through Literary Texts and Persona Conditioning

Naruki Shirahama, Naofumi Nakaya, Yuma Yoshimoto, Satoshi Watanabe
article en

Abstract

This paper examines whether multilingual prompt-and-text conditions materially alter large language model (LLM) emotion evaluation rather than merely rephrasing the same task. Using OpenRouter as a unified inference layer, we evaluated six contemporary LLMs under three full-language conditions (Japanese, English, and Traditional Chinese), three literary texts, four personas, and three repeated API calls per condition. Each completion rated four emotional dimensions — Interesting, Surprise, Sadness, and Anger — and provided a brief rationale. The design comprised 648 planned evaluations (6 models × 3 languages × 3 texts × 4 personas × 3 trials). The final combined dataset contained 648 valid records, comprising 631 original records and 17 replacement records obtained under a repair amendment registered after the main run and before the patch run. Descriptive summaries and preregistered ordinary least squares analyses with HC3 robust standard errors showed that text content was a major driver of scores, especially for Sadness and Anger. Simultaneously, model-language interactions were significant for all four emotions, indicating that the effect of the language condition varied substantially across models. English yielded the highest mean Interesting, Surprise, and Sadness scores, whereas Japanese yielded the highest mean Anger score. However, these aggregate patterns mask the strong model-specific contrasts. The findings show that multilingual literary evaluation is shaped by both the text itself and the model processing of its translation. This study contributes a multilingual literary emotion benchmark, a preregistered and repair-aware evaluation pipeline, and evidence that multilingual conditions are substantive experimental factors for LLM emotion profiling.

Journal of Advanced Computational Intelligence and Intelligent InformaticsVol. 30(6)
Shimonoseki City University (JP), National Institute of Technology (JP), Juntendo University Urayasu Hospital (JP), Shizuoka Institute of Science and Technology (JP)
Sentiment Analysis and Opinion Mining
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon