Comparative Evaluation of ScholarGPT and ChatGPT-4 Omni in Pediatric Dentistry: Accuracy and Completeness Analysis.

<b>Purpose:</b> Evaluate and compare the accuracy and completeness of responses provided by ScholarGPT and ChatGPT-4 Omni (ChatGPT-4o) to clinical questions in pediatric dentistry. <b>Methods:</b> Thirty clinical questions across six clinical topics were developed. Responses were collected from ScholarGPT and ChatGPT-4o and independently evaluated by six experienced pediatric dentists. The evaluators used a five-point Likert scale for accuracy and three-point scale for completeness. Accuracy was rated for factual correctness, relevance, and coherence, while completeness reflected how fully the response addressed the question. Statistical analysis was performed using non-parametric tests, including the Wilcoxon signed-rank and Kruskal-Wallis tests. <b>Results:</b> ScholarGPT received significantly higher median accuracy scores (five, interquartile range [IQR] equals zero) compared to ChatGPT-4o (four, IQR equals one) across all topics (P<0.001). In completeness scores, ScholarGPT (three, IQR equals one) also out-performed ChatGPT-4o (two, IQR equals zero; P<0.001). ScholarGPT showed the highest accuracy in the "fissure sealants" (five, IQR equals zero), while the lowest was observed in "development of dentition and occlusion" (five, IQR equals one). ChatGPT-4o yielded the lowest accuracy in "development of dentition and occlusion" (four, IQR equals two) and the highest in "fluoride" (four, IQR equals one). Accuracy scores varied significantly across topics for both ChatGPT-4o (P=0.012) and ScholarGPT (P=0.001). However, differences in completeness across topics were observed only for ScholarGPT (P=0.008). <b>Conclusions:</b> ScholarGPT provided more accurate and complete responses to pediatric dentistry questions than ChatGPT-4o, suggesting that domain-specific artificial intelligence tools can aid dental education and clinical support, though further refinement is needed.

Authors

Institutions

Publication Details

Journal
PubMed
Published
2025-11-15
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comparative Evaluation of ScholarGPT and ChatGPT-4 Omni in Pediatric Dentistry: Accuracy and Completeness Analysis.

Berkant Sezer, Alev Eda Okutan
PubMed
Artificial Intelligence in Healthcare and Education
article

Comparative Evaluation of ScholarGPT and ChatGPT-4 Omni in Pediatric Dentistry: Accuracy and Completeness Analysis.

Berkant Sezer, Alev Eda Okutan
article en

Abstract

<b>Purpose:</b> Evaluate and compare the accuracy and completeness of responses provided by ScholarGPT and ChatGPT-4 Omni (ChatGPT-4o) to clinical questions in pediatric dentistry. <b>Methods:</b> Thirty clinical questions across six clinical topics were developed. Responses were collected from ScholarGPT and ChatGPT-4o and independently evaluated by six experienced pediatric dentists. The evaluators used a five-point Likert scale for accuracy and three-point scale for completeness. Accuracy was rated for factual correctness, relevance, and coherence, while completeness reflected how fully the response addressed the question. Statistical analysis was performed using non-parametric tests, including the Wilcoxon signed-rank and Kruskal-Wallis tests. <b>Results:</b> ScholarGPT received significantly higher median accuracy scores (five, interquartile range [IQR] equals zero) compared to ChatGPT-4o (four, IQR equals one) across all topics (P<0.001). In completeness scores, ScholarGPT (three, IQR equals one) also out-performed ChatGPT-4o (two, IQR equals zero; P<0.001). ScholarGPT showed the highest accuracy in the "fissure sealants" (five, IQR equals zero), while the lowest was observed in "development of dentition and occlusion" (five, IQR equals one). ChatGPT-4o yielded the lowest accuracy in "development of dentition and occlusion" (four, IQR equals two) and the highest in "fluoride" (four, IQR equals one). Accuracy scores varied significantly across topics for both ChatGPT-4o (P=0.012) and ScholarGPT (P=0.001). However, differences in completeness across topics were observed only for ScholarGPT (P=0.008). <b>Conclusions:</b> ScholarGPT provided more accurate and complete responses to pediatric dentistry questions than ChatGPT-4o, suggesting that domain-specific artificial intelligence tools can aid dental education and clinical support, though further refinement is needed.

PubMedVol. 47(6)
Çanakkale Onsekiz Mart Üniversitesi (TR), IS practice (BE)
Quality Education
Openalex Percentile: Top 34%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.