Empathy Without Assumptions: A Theory of Where Understanding Comes From Keeps an AI Coach's Replies Acceptable While Avoiding Unfounded Assumptions

Background. Language models used for coaching and emotional support can state feelings, causes or details about the user that the user never expressed. We treat such unfounded assumptions as a form of hallucination about the user. Instructions that forbid them may make replies less acceptable: the safest reply then repeats the person's words, and helping-skills research holds that repetition alone does not convey understanding. Objective. This exploratory pilot tested whether an AI coach instructed with a theory of where understanding comes from can avoid unfounded assumptions while keeping its replies acceptable as empathic. Methods. Three versions of the coach's empathy instructions (a one-sentence baseline, a reflection-only account of reflective listening and an evidence-grounded theory of empathy) ran on the same code. A general-purpose model given a one-line coaching prompt served as a fourth condition. Each condition replied five times to 24 fictional conversations (120 replies per condition). Two AI judges (large language models) rated every reply for acceptability and for unfounded assumptions. Four human raters rated 93 replies from an earlier run, to check how far the AI judges agreed with human judgement. Differences were analysed with the conversation as the unit, with 95% bootstrap intervals and a correction for 16 tests. Results. The evidence-grounded instructions produced acceptable replies far more often than the reflection-only instructions (71% against 38% for the primary AI judge; 53% against 14% for the secondary AI judge). They made unfounded assumptions about as rarely (4% each for the primary AI judge). They were also acceptable far more often than the general-purpose model (71% against 14%; 53% against 13%). Against the baseline, unfounded assumptions were lower (4% against 9%; 13% against 26%), but not significantly so. The AI judges agreed with the human raters' majority substantially (primary) and moderately (secondary) on unfounded assumptions. Conclusions. A short theory of where understanding comes from let an AI coach keep unfounded assumptions low without the loss of acceptability that reflection-only instructions caused. A confirmatory study will test the reduction relative to a minimal baseline.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-18
DOI
https://doi.org/10.5281/zenodo.24347177
Primary Topic
Social Robot Interaction and HRI
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Empathy Without Assumptions: A Theory of Where Understanding Comes From Keeps an AI Coach's Replies Acceptable While Avoiding Unfounded Assumptions

Anne Jamaluddin, John Pinto
2 links
Zenodo (CERN European Organization for Nuclear Research)
Social Robot Interaction and HRI
preprint

Empathy Without Assumptions: A Theory of Where Understanding Comes From Keeps an AI Coach's Replies Acceptable While Avoiding Unfounded Assumptions

Anne Jamaluddin, John Pinto
preprint en

Abstract

Background. Language models used for coaching and emotional support can state feelings, causes or details about the user that the user never expressed. We treat such unfounded assumptions as a form of hallucination about the user. Instructions that forbid them may make replies less acceptable: the safest reply then repeats the person's words, and helping-skills research holds that repetition alone does not convey understanding. Objective. This exploratory pilot tested whether an AI coach instructed with a theory of where understanding comes from can avoid unfounded assumptions while keeping its replies acceptable as empathic. Methods. Three versions of the coach's empathy instructions (a one-sentence baseline, a reflection-only account of reflective listening and an evidence-grounded theory of empathy) ran on the same code. A general-purpose model given a one-line coaching prompt served as a fourth condition. Each condition replied five times to 24 fictional conversations (120 replies per condition). Two AI judges (large language models) rated every reply for acceptability and for unfounded assumptions. Four human raters rated 93 replies from an earlier run, to check how far the AI judges agreed with human judgement. Differences were analysed with the conversation as the unit, with 95% bootstrap intervals and a correction for 16 tests. Results. The evidence-grounded instructions produced acceptable replies far more often than the reflection-only instructions (71% against 38% for the primary AI judge; 53% against 14% for the secondary AI judge). They made unfounded assumptions about as rarely (4% each for the primary AI judge). They were also acceptable far more often than the general-purpose model (71% against 14%; 53% against 13%). Against the baseline, unfounded assumptions were lower (4% against 9%; 13% against 26%), but not significantly so. The AI judges agreed with the human raters' majority substantially (primary) and moderately (secondary) on unfounded assumptions. Conclusions. A short theory of where understanding comes from let an AI coach keep unfounded assumptions low without the loss of acceptability that reflection-only instructions caused. A confirmatory study will test the reduction relative to a minimal baseline.

Zenodo (CERN European Organization for Nuclear Research)
UCSI University (MY)
Social Robot Interaction and HRI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon