Professional Quality and Empathy of Responses Provided by AI and Dentists: A Cross-Sectional Study

<b>Background/Objectives:</b> Artificial intelligence-based language models such as ChatGPT are increasingly used in medical communication, yet their performance compared with human clinicians remains insufficiently explored in dentistry. Because communication quality, including accuracy and empathy, is essential for patient understanding, this study aimed to compare ChatGPT's responses with those of dentists with different levels of professional experience. <b>Methods:</b> Ten standardized dental patient questions were generated by the authors and answered by ChatGPT and by three dentist groups (<2 years, 2-5 years, >5 years of experience; one respondent per group, randomly selected from five eligible dentists). Subsequently, 30 dentists rated the professional quality of the responses, and 50 patients evaluated perceived empathy on 4-point scales. Group differences were analyzed using the non-parametric Friedman test with exact post hoc comparisons and Bonferroni correction. <b>Results:</b> ChatGPT received higher ratings than all dentist groups in both domains. Mean empathy scores were 3.23 for ChatGPT versus 1.73-2.14 for dentists, and mean quality scores were 3.50 versus 1.79-2.21 (all <i>p</i> < 0.001). Early-career dentists scored moderately higher than the most experienced group but consistently below ChatGPT. Due to the exploratory design and small number of respondents per experience group, these findings should be interpreted cautiously. <b>Conclusions:</b> ChatGPT generated responses rated as more empathetic and of higher professional quality than those of participating dentists. This suggests potential value for supporting routine, text-based dental communication. However, limitations such as lack of genuine empathy, data privacy concerns, and clinical responsibility must be considered. Larger studies are needed to validate these results.

Authors

Institutions

Publication Details

Journal
Healthcare
Published
2025-11-27
DOI
https://doi.org/10.3390/healthcare13233099
Citations
1
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.65
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Professional Quality and Empathy of Responses Provided by AI and Dentists: A Cross-Sectional Study

Lisa Zöll, Dandara Haag, James Deschner, Anke Hollinderbäumer et al.
1 citations
Healthcare
Artificial Intelligence in Healthcare and Education
0.65
article

Professional Quality and Empathy of Responses Provided by AI and Dentists: A Cross-Sectional Study

Lisa Zöll, Dandara Haag, James Deschner, Anke Hollinderbäumer, Luisa Schäfer, Thekla J. Pfeiffer-Grötz
article en
1 citations

Abstract

<b>Background/Objectives:</b> Artificial intelligence-based language models such as ChatGPT are increasingly used in medical communication, yet their performance compared with human clinicians remains insufficiently explored in dentistry. Because communication quality, including accuracy and empathy, is essential for patient understanding, this study aimed to compare ChatGPT's responses with those of dentists with different levels of professional experience. <b>Methods:</b> Ten standardized dental patient questions were generated by the authors and answered by ChatGPT and by three dentist groups (<2 years, 2-5 years, >5 years of experience; one respondent per group, randomly selected from five eligible dentists). Subsequently, 30 dentists rated the professional quality of the responses, and 50 patients evaluated perceived empathy on 4-point scales. Group differences were analyzed using the non-parametric Friedman test with exact post hoc comparisons and Bonferroni correction. <b>Results:</b> ChatGPT received higher ratings than all dentist groups in both domains. Mean empathy scores were 3.23 for ChatGPT versus 1.73-2.14 for dentists, and mean quality scores were 3.50 versus 1.79-2.21 (all <i>p</i> < 0.001). Early-career dentists scored moderately higher than the most experienced group but consistently below ChatGPT. Due to the exploratory design and small number of respondents per experience group, these findings should be interpreted cautiously. <b>Conclusions:</b> ChatGPT generated responses rated as more empathetic and of higher professional quality than those of participating dentists. This suggests potential value for supporting routine, text-based dental communication. However, limitations such as lack of genuine empathy, data privacy concerns, and clinical responsibility must be considered. Larger studies are needed to validate these results.

HealthcareVol. 13(23)
Johannes Gutenberg University Mainz (DE), University Medical Center of the Johannes Gutenberg University Mainz (DE)
Openalex Percentile: Top 19%
Artificial Intelligence in Healthcare and Education
0.65
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.