Evaluation of Large Language Model-Based Chatbots' Accuracy in Responding to CBCT-Related Questions in Endodontics: A Guideline-Based Assessment

Aim To evaluate the accuracy and guideline compliance of ChatGPT and Claude regarding the use of cone beam computed tomography (CBCT) in endodontics, based on the European Society of Endodontology (ESE) position statement: use of CBCT in endodontics.Material and method A structured question set comprising 32 true/false statements and 8 open-ended questions was developed based on the ESE position statement. Questions were reviewed by an endodontic specialist and covered four main categories: CBCT indications and justification, radiation dose and imaging parameters, technical application and image interpretation, and training requirements and clinical responsibility. ChatGPT version 5.2 and Claude 4.5 Sonnet were evaluated in separate chat sessions without chat history. All responses were evaluated by a single investigator based on the ESE criteria. Data collection was completed on January 14, 2026. Results Both ChatGPT 5.2 and Claude 4.5 Sonnet achieved an overall accuracy of 97.5% (39/40 correct responses). For true/false statements, both chatbots correctly answered 31 out of 32 questions (96.88%), with identical errors on question 23. For open-ended questions, both achieved 100% accuracy (8/8 correct). McNemar's test could not be computed due to the absence of discordant pairs, indicating perfect agreement. Chi-square analysis showed no statistically significant difference between the two chatbots (χ² = 0.000, p = 1.000).Conclusion Both ChatGPT 5.2 and Claude 4.5 Sonnet demonstrated excellent accuracy and guideline compliance regarding CBCT use in endodontics based on the ESE position statement, suggesting their potential utility for guideline-based information retrieval in dental education and clinical practice.

Authors

Institutions

Publication Details

Journal
Eurasian Dental Research
Published
2026-04-30
DOI
https://doi.org/10.62243/edr.1880544
Primary Topic
Dental Radiography and Imaging
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluation of Large Language Model-Based Chatbots' Accuracy in Responding to CBCT-Related Questions in Endodontics: A Guideline-Based Assessment

Soner Şişmanoğlu, Vasfiye Işık
Eurasian Dental Research
Dental Radiography and Imaging
article

Evaluation of Large Language Model-Based Chatbots' Accuracy in Responding to CBCT-Related Questions in Endodontics: A Guideline-Based Assessment

Soner Şişmanoğlu, Vasfiye Işık
article en

Abstract

Aim To evaluate the accuracy and guideline compliance of ChatGPT and Claude regarding the use of cone beam computed tomography (CBCT) in endodontics, based on the European Society of Endodontology (ESE) position statement: use of CBCT in endodontics.Material and method A structured question set comprising 32 true/false statements and 8 open-ended questions was developed based on the ESE position statement. Questions were reviewed by an endodontic specialist and covered four main categories: CBCT indications and justification, radiation dose and imaging parameters, technical application and image interpretation, and training requirements and clinical responsibility. ChatGPT version 5.2 and Claude 4.5 Sonnet were evaluated in separate chat sessions without chat history. All responses were evaluated by a single investigator based on the ESE criteria. Data collection was completed on January 14, 2026. Results Both ChatGPT 5.2 and Claude 4.5 Sonnet achieved an overall accuracy of 97.5% (39/40 correct responses). For true/false statements, both chatbots correctly answered 31 out of 32 questions (96.88%), with identical errors on question 23. For open-ended questions, both achieved 100% accuracy (8/8 correct). McNemar's test could not be computed due to the absence of discordant pairs, indicating perfect agreement. Chi-square analysis showed no statistically significant difference between the two chatbots (χ² = 0.000, p = 1.000).Conclusion Both ChatGPT 5.2 and Claude 4.5 Sonnet demonstrated excellent accuracy and guideline compliance regarding CBCT use in endodontics based on the ESE position statement, suggesting their potential utility for guideline-based information retrieval in dental education and clinical practice.

Eurasian Dental ResearchVol. 4(1)
Istanbul University-Cerrahpaşa (TR)
Quality Education
Openalex Percentile: Top 9%
Dental Radiography and Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.