Reduced symptom reporting quality during human–chatbot versus human–physician interactions

Abstract Artificial intelligence (AI) chatbots are increasingly used for self-triage and medical advice seeking. Accurate AI performance, however, hinges on how users interact with such consumer-facing applications. While previous research has identified reservations regarding AI-generated medical advice, earlier stages of human–AI interaction, such as how symptoms are communicated, remain largely unexplored. In a preregistered between-subject experiment ( n = 500), participants were randomly assigned to provide simulated symptom reports for common medical conditions to either an AI chatbot or a human physician. We evaluated the quality of the reports for an initial medical urgency assessment using physician-validated large language model-based suitability metrics. Participants who believed they were interacting with an AI tool (versus a physician) provided lower-quality symptom reports for medical triage. Our findings indicate a bias in how users communicate symptoms in digital settings. This outcome could compromise the performance of consumer-facing AI tools in real-world applications, regardless of the underlying model’s actual capacity.

Authors

Publication Details

Journal
Nature Health
Published
2026-05-01
DOI
https://doi.org/10.1038/s44360-026-00116-y
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Reduced symptom reporting quality during human–chatbot versus human–physician interactions

Wilfried Kunde, Yeun Joon Kim, Jess Lim, Sebastian D. Boie et al.
Nature Health
Artificial Intelligence in Healthcare and Education
article

Reduced symptom reporting quality during human–chatbot versus human–physician interactions

Wilfried Kunde, Yeun Joon Kim, Jess Lim, Sebastian D. Boie, Aylin Demir, Florian Reis, Moritz Reis, Matthias I. Gröschel
article en

Abstract

Abstract Artificial intelligence (AI) chatbots are increasingly used for self-triage and medical advice seeking. Accurate AI performance, however, hinges on how users interact with such consumer-facing applications. While previous research has identified reservations regarding AI-generated medical advice, earlier stages of human–AI interaction, such as how symptoms are communicated, remain largely unexplored. In a preregistered between-subject experiment ( n = 500), participants were randomly assigned to provide simulated symptom reports for common medical conditions to either an AI chatbot or a human physician. We evaluated the quality of the reports for an initial medical urgency assessment using physician-validated large language model-based suitability metrics. Participants who believed they were interacting with an AI tool (versus a physician) provided lower-quality symptom reports for medical triage. Our findings indicate a bias in how users communicate symptoms in digital settings. This outcome could compromise the performance of consumer-facing AI tools in real-world applications, regardless of the underlying model’s actual capacity.

Nature Health
Openalex Percentile: Top 11%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.