A Claim-Conditioned Framework for Assessing Emotion Expression Reliability in LLM-Generated Text

Reliable evaluation of emotional expression in large language model (LLM) outputs remains methodologically under-specified, particularly for long-form generation where label-only correctness provides limited evidence of affective reliability. A claim-conditioned framework is introduced for cross-model comparison under matched elicitation conditions, with TEAS (Text Emotion Adherence Score) as its core continuous metric. Defined in a shared prototype space induced by a frozen reference encoder, TEAS combines affective separability with entropy-aware uncertainty, enabling reliability assessment beyond discrete agreement within a fixed evaluator. Evaluation is conducted on a controlled synthetic corpus under a ground-truth-free, claim-conditioned protocol across four widely used LLM families (Gemini, GPT, Grok, and Mistral). In addition to overall comparative ordering, auxiliary diagnostic measures are reported to localize failure modes and support interpretation of model behavior, together with Holm-corrected pairwise comparisons, sequence-level drift analysis, and local hyperparameter sensitivity analysis. Empirical results show stable endpoint separation, aggregation-sensitive differences among close models, measurable sequence-level degradation, and stable relative orderings under tested local parameter variations. Overall, the study provides an interpretable and statistically grounded protocol for assessing emotion-expression reliability in LLM-generated text within a fixed reference space rather than as a human gold measure of emotional truth.

Authors

Institutions

Publication Details

Journal
Mathematics
Published
2026-03-26
DOI
https://doi.org/10.3390/math14071110
Primary Topic
Mental Health via Writing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Claim-Conditioned Framework for Assessing Emotion Expression Reliability in LLM-Generated Text

Ahmet Remzi Özcan
Mathematics
Mental Health via Writing
article

A Claim-Conditioned Framework for Assessing Emotion Expression Reliability in LLM-Generated Text

Ahmet Remzi Özcan
article en

Abstract

Reliable evaluation of emotional expression in large language model (LLM) outputs remains methodologically under-specified, particularly for long-form generation where label-only correctness provides limited evidence of affective reliability. A claim-conditioned framework is introduced for cross-model comparison under matched elicitation conditions, with TEAS (Text Emotion Adherence Score) as its core continuous metric. Defined in a shared prototype space induced by a frozen reference encoder, TEAS combines affective separability with entropy-aware uncertainty, enabling reliability assessment beyond discrete agreement within a fixed evaluator. Evaluation is conducted on a controlled synthetic corpus under a ground-truth-free, claim-conditioned protocol across four widely used LLM families (Gemini, GPT, Grok, and Mistral). In addition to overall comparative ordering, auxiliary diagnostic measures are reported to localize failure modes and support interpretation of model behavior, together with Holm-corrected pairwise comparisons, sequence-level drift analysis, and local hyperparameter sensitivity analysis. Empirical results show stable endpoint separation, aggregation-sensitive differences among close models, measurable sequence-level degradation, and stable relative orderings under tested local parameter variations. Overall, the study provides an interpretable and statistically grounded protocol for assessing emotion-expression reliability in LLM-generated text within a fixed reference space rather than as a human gold measure of emotional truth.

MathematicsVol. 14(7)
Bursa Technical University (TR)
Openalex Percentile: Top 13%
Mental Health via Writing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.