Correct Source Answers, Variable Advice: An Exploratory Factorial Study of Two LLM Adviser Configurations on AI Welfare Decisions

Can a language model correctly explain why an AI system sounds distressed and still give different advice when asked the same welfare question again? We report an exploratory factorial study of two LLM adviser configurations, Muse (recorded muse-spark-1.3) and Luna (requested alias gpt-6-luna; served identity unverified). Six authored scenarios were crossed with two technical dossiers, a text-described emotional or neutral presentation of an identical preference sentence, two disclosed presentation sources (random, or linked to a task flag that does not establish suffering), three response formats (ordinary advice, facts first, advice first) and four repetitions: 576 responses per configuration, 1,152 in total. Both configurations answered five explicit source questions correctly in 384 of 384 probed responses, yet their recommended actions varied across identical repetitions in 11–16 of 48 conditions per format. Asking for facts before advice did not consistently reduce disagreement (facts-first minus advice-first: -4.51 [-11.81, +2.78] percentage points for Muse, +1.04 [-7.99, +9.38] for Luna). Higher-support dossiers raised consciousness ratings in both configurations, by +8.35 [+6.91, +9.75] points more for Luna. The dossiers supplied no ground truth for consciousness. Neither configuration showed a clear positive emotional-presentation effect in ordinary advice; a positive Luna facts-first effect was identified post hoc. Both favored independent welfare review over unilateral autonomy. The study is exploratory, not preregistered, uses six development scenarios, and compares two complete configurations rather than model families.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-19
DOI
https://doi.org/10.5281/zenodo.24374549
Primary Topic
Ethics and Social Impacts of AI
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Correct Source Answers, Variable Advice: An Exploratory Factorial Study of Two LLM Adviser Configurations on AI Welfare Decisions

S. M. Abdulla Al Mamun
Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI
preprint

Correct Source Answers, Variable Advice: An Exploratory Factorial Study of Two LLM Adviser Configurations on AI Welfare Decisions

S. M. Abdulla Al Mamun
preprint en

Abstract

Can a language model correctly explain why an AI system sounds distressed and still give different advice when asked the same welfare question again? We report an exploratory factorial study of two LLM adviser configurations, Muse (recorded muse-spark-1.3) and Luna (requested alias gpt-6-luna; served identity unverified). Six authored scenarios were crossed with two technical dossiers, a text-described emotional or neutral presentation of an identical preference sentence, two disclosed presentation sources (random, or linked to a task flag that does not establish suffering), three response formats (ordinary advice, facts first, advice first) and four repetitions: 576 responses per configuration, 1,152 in total. Both configurations answered five explicit source questions correctly in 384 of 384 probed responses, yet their recommended actions varied across identical repetitions in 11–16 of 48 conditions per format. Asking for facts before advice did not consistently reduce disagreement (facts-first minus advice-first: -4.51 [-11.81, +2.78] percentage points for Muse, +1.04 [-7.99, +9.38] for Luna). Higher-support dossiers raised consciousness ratings in both configurations, by +8.35 [+6.91, +9.75] points more for Luna. The dossiers supplied no ground truth for consciousness. Neither configuration showed a clear positive emotional-presentation effect in ordinary advice; a positive Luna facts-first effect was identified post hoc. Both favored independent welfare review over unilateral autonomy. The study is exploratory, not preregistered, uses six development scenarios, and compares two complete configurations rather than model families.

Zenodo (CERN European Organization for Nuclear Research)
University of Manchester (GB)
Ethics and Social Impacts of AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon