Performance of GPT-5, DeepSeek, and Claude in dental MCQs for medically compromised patients

Artificial intelligence (AI) has shown remarkable potential in medical education and clinical decision support, yet its role in dentistry—particularly in the management of medically compromised patients—remains largely unexplored. No previous study has systematically benchmarked the performance of advanced large language models (LLMs) in this high-risk domain. This study provides the first comparative evaluation of three LLMs—GPT-5, DeepSeek, and Claude—on multiple-choice questions (MCQs) specifically designed for dental management of medically compromised patients. A total of 72 validated MCQs were constructed from the 10th edition of Little & Falace’s Dental Management of the Medically Compromised Patient, covering 18 systemic conditions relevant to dental practice. Each model was independently assessed under identical conditions. Accuracy, agreement with the gold standard answers from the textbook, and error patterns were analyzed. GPT-5 achieved the highest accuracy (90.28%), followed by Claude (88.89%) and DeepSeek (87.50%). Performance varied across systemic conditions, with all models demonstrating lower accuracy in complex scenarios such as infective endocarditis and bleeding disorders. Qualitative analysis revealed differences in reasoning depth, error types, and consistency of responses. This is the first study to benchmark multiple frontier LLMs in dentistry, focusing on medically compromised patients—a group where safe and accurate decision-making is essential. The findings highlight both the promise and limitations of AI in dental education and clinical guidance. By systematically identifying strengths and weaknesses, this work provides an evidence base for integrating LLMs into dental curricula and decision-support systems, while underscoring the need for human oversight in complex medical cases. Generative AI models, including GPT-5, DeepSeek, and Claude, demonstrated high accuracy in case-based dental decision-making for medically compromised patients. Their integration could enhance dental education and clinical support. However, variability in performance underscores the need for cautious use and further validation before applying AI tools in complex patient care.

Authors

Institutions

Publication Details

Journal
Journal of Translational Medicine
Published
2026-01-29
DOI
https://doi.org/10.1186/s12967-026-07763-5
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Performance of GPT-5, DeepSeek, and Claude in dental MCQs for medically compromised patients

Ahmed Bashah, Omran Altos, Ahmed Awad, Gang Chen
Journal of Translational Medicine
Artificial Intelligence in Healthcare and Education
article

Performance of GPT-5, DeepSeek, and Claude in dental MCQs for medically compromised patients

Ahmed Bashah, Omran Altos, Ahmed Awad, Gang Chen
article en

Abstract

Artificial intelligence (AI) has shown remarkable potential in medical education and clinical decision support, yet its role in dentistry—particularly in the management of medically compromised patients—remains largely unexplored. No previous study has systematically benchmarked the performance of advanced large language models (LLMs) in this high-risk domain. This study provides the first comparative evaluation of three LLMs—GPT-5, DeepSeek, and Claude—on multiple-choice questions (MCQs) specifically designed for dental management of medically compromised patients. A total of 72 validated MCQs were constructed from the 10th edition of Little & Falace’s Dental Management of the Medically Compromised Patient, covering 18 systemic conditions relevant to dental practice. Each model was independently assessed under identical conditions. Accuracy, agreement with the gold standard answers from the textbook, and error patterns were analyzed. GPT-5 achieved the highest accuracy (90.28%), followed by Claude (88.89%) and DeepSeek (87.50%). Performance varied across systemic conditions, with all models demonstrating lower accuracy in complex scenarios such as infective endocarditis and bleeding disorders. Qualitative analysis revealed differences in reasoning depth, error types, and consistency of responses. This is the first study to benchmark multiple frontier LLMs in dentistry, focusing on medically compromised patients—a group where safe and accurate decision-making is essential. The findings highlight both the promise and limitations of AI in dental education and clinical guidance. By systematically identifying strengths and weaknesses, this work provides an evidence base for integrating LLMs into dental curricula and decision-support systems, while underscoring the need for human oversight in complex medical cases. Generative AI models, including GPT-5, DeepSeek, and Claude, demonstrated high accuracy in case-based dental decision-making for medically compromised patients. Their integration could enhance dental education and clinical support. However, variability in performance underscores the need for cautious use and further validation before applying AI tools in complex patient care.

Journal of Translational MedicineVol. 24(1)
Dalian Medical University (CN), First Affiliated Hospital of Dalian Medical University (CN), Affiliated Zhongshan Hospital of Dalian University (CN)
Quality Education
Openalex Percentile: Top 75%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.