Guideline-Based Accuracy Scores and Educational Quality of Artificial Intelligence-Based Language Model Responses to Search-Result-Derived Korean Pediatric Dental Trauma Queries: A Two-Time-Point Exploratory Study

This exploratory study described guideline-based accuracy scores, educational quality, and temporal variation in ChatGPT and Gemini responses to eight searchresult-derived Korean pediatric dental trauma queries. Four tooth-avulsion and four crown-fracture prompts were submitted once to each service in January 2026 and one month later. The queries were treated as a convenience sample of recurrent searchresult content, not a representative set of caregiver questions. Two pediatric dentists scored 32 responses using query-specific key points, predefined major errors, and the Global Quality Score. Inter-rater quadratic weighted kappa was 0.910 for the guideline-based accuracy score and 0.835 for the Global Quality Score. ChatGPT accuracy scores were unchanged in five prompts, increased in one, and decreased in two; Global Quality Score values were unchanged in six and decreased in two. Gemini accuracy scores were unchanged in four, increased in one, and decreased in three; all Global Quality Score values were unchanged. No predefined major errors were identified, but avulsion-related terminology appeared in three of four crown-fragment reattachment responses. Within the sampled queries, clinically important omissions, injury-concept mixing, and temporal variation were observed. The findings do not represent caregiver information needs or establish real-world educational effectiveness, repeatability, or service superiority.

Authors

Institutions

Publication Details

Journal
THE JOURNAL OF THE KOREAN ACADEMY OF PEDTATRIC DENTISTRY
Published
2026-08-25
DOI
https://doi.org/10.5933/jkapd.2026.53.3.320
Primary Topic
Dental Trauma and Treatments
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Guideline-Based Accuracy Scores and Educational Quality of Artificial Intelligence-Based Language Model Responses to Search-Result-Derived Korean Pediatric Dental Trauma Queries: A Two-Time-Point Exploratory Study

Hyewon Shin, Seonmi Kim, Doyeon Won
THE JOURNAL OF THE KOREAN ACADEMY OF PEDTATRIC DENTISTRY
Dental Trauma and Treatments
article

Guideline-Based Accuracy Scores and Educational Quality of Artificial Intelligence-Based Language Model Responses to Search-Result-Derived Korean Pediatric Dental Trauma Queries: A Two-Time-Point Exploratory Study

Hyewon Shin, Seonmi Kim, Doyeon Won
article en

Abstract

This exploratory study described guideline-based accuracy scores, educational quality, and temporal variation in ChatGPT and Gemini responses to eight searchresult-derived Korean pediatric dental trauma queries. Four tooth-avulsion and four crown-fracture prompts were submitted once to each service in January 2026 and one month later. The queries were treated as a convenience sample of recurrent searchresult content, not a representative set of caregiver questions. Two pediatric dentists scored 32 responses using query-specific key points, predefined major errors, and the Global Quality Score. Inter-rater quadratic weighted kappa was 0.910 for the guideline-based accuracy score and 0.835 for the Global Quality Score. ChatGPT accuracy scores were unchanged in five prompts, increased in one, and decreased in two; Global Quality Score values were unchanged in six and decreased in two. Gemini accuracy scores were unchanged in four, increased in one, and decreased in three; all Global Quality Score values were unchanged. No predefined major errors were identified, but avulsion-related terminology appeared in three of four crown-fragment reattachment responses. Within the sampled queries, clinically important omissions, injury-concept mixing, and temporal variation were observed. The findings do not represent caregiver information needs or establish real-world educational effectiveness, repeatability, or service superiority.

THE JOURNAL OF THE KOREAN ACADEMY OF PEDTATRIC DENTISTRYVol. 53(3)
Chonnam National University (KR), Yang Hospital (KR)
Quality Education
Openalex Percentile: Top 7%
Dental Trauma and Treatments
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Guideline-Based Accuracy Scores and Educational Quality of Artificial Intelligence-Based Language Model Responses to Search-Result-Derived Korean Pediatric Dental Trauma Queries: A Two-Time-Point Exploratory Study — Hyewon Shin, Seonmi Kim, et al. · THE JOURNAL OF THE KOREAN ACADEMY OF PEDTATRIC DENTISTRY (2026) | TGRS Research Map | TGRS