Does Sequential Use of Multiple Chatbots Influence Emergency Guidance for Dental Avulsion?

BACKGROUND/AIM: Artificial intelligence-based chatbot systems are increasingly used for dental emergency guidance, yet the clinical value of sequential consultation remains unclear. This study investigated whether response order influences the quality of chatbot-generated answers to permanent tooth avulsion questions. MATERIAL AND METHODS: Eight frequently asked questions covering key decision points in avulsion management were developed based on International Association of Dental Traumatology guidelines. Three publicly accessible chatbots-ChatGPT (GPT-5), Gemini (Gemini 1.5 Pro), and DeepSeek (DeepSeek-R1)-were queried using a standardized sequential prompt design. For each question, all chatbot order permutations were applied so that each system generated first-, second-, and third-position responses. Second- and third-position prompts required evaluation of prior responses and correction of missing or incorrect information, thereby creating a controlled "maximum correction opportunity" condition. Responses were generated in independent sessions and evaluated by three expert dentists blinded to model identity using predefined criteria: accuracy, safety, completeness, correction ability, clarity, and usefulness. Composite scores were calculated within seven conceptual evaluation frameworks, and response-order effects were tested using the Friedman test with Kendall's W. RESULTS: Across all seven conceptual evaluation frameworks, composite quality scores did not differ significantly according to response order (all p > 0.05), with Kendall's W indicating negligible effect sizes. No consistent improvement was observed in accuracy, safety, completeness, or correction ability in second- or third-position responses. Model-specific analyses confirmed the absence of response-order effects across all chatbot platforms. CONCLUSIONS: Under structured evaluative conditions permitting explicit revision, sequential consultation of multiple chatbot systems did not improve the quality, safety, or guideline alignment of information provided for dental avulsion management. These findings suggest that response-order effects alone may have limited corrective impact in this context and should be interpreted within the boundaries of controlled experimental modeling.

Authors

Institutions

Publication Details

Journal
Dental Traumatology
Published
2026-04-27
DOI
https://doi.org/10.1111/edt.70072
Primary Topic
AI in Service Interactions
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Does Sequential Use of Multiple Chatbots Influence Emergency Guidance for Dental Avulsion?

Mehmet Buldur, Berkant Sezer
Dental Traumatology
AI in Service Interactions
article

Does Sequential Use of Multiple Chatbots Influence Emergency Guidance for Dental Avulsion?

Mehmet Buldur, Berkant Sezer
article en

Abstract

BACKGROUND/AIM: Artificial intelligence-based chatbot systems are increasingly used for dental emergency guidance, yet the clinical value of sequential consultation remains unclear. This study investigated whether response order influences the quality of chatbot-generated answers to permanent tooth avulsion questions. MATERIAL AND METHODS: Eight frequently asked questions covering key decision points in avulsion management were developed based on International Association of Dental Traumatology guidelines. Three publicly accessible chatbots-ChatGPT (GPT-5), Gemini (Gemini 1.5 Pro), and DeepSeek (DeepSeek-R1)-were queried using a standardized sequential prompt design. For each question, all chatbot order permutations were applied so that each system generated first-, second-, and third-position responses. Second- and third-position prompts required evaluation of prior responses and correction of missing or incorrect information, thereby creating a controlled "maximum correction opportunity" condition. Responses were generated in independent sessions and evaluated by three expert dentists blinded to model identity using predefined criteria: accuracy, safety, completeness, correction ability, clarity, and usefulness. Composite scores were calculated within seven conceptual evaluation frameworks, and response-order effects were tested using the Friedman test with Kendall's W. RESULTS: Across all seven conceptual evaluation frameworks, composite quality scores did not differ significantly according to response order (all p > 0.05), with Kendall's W indicating negligible effect sizes. No consistent improvement was observed in accuracy, safety, completeness, or correction ability in second- or third-position responses. Model-specific analyses confirmed the absence of response-order effects across all chatbot platforms. CONCLUSIONS: Under structured evaluative conditions permitting explicit revision, sequential consultation of multiple chatbot systems did not improve the quality, safety, or guideline alignment of information provided for dental avulsion management. These findings suggest that response-order effects alone may have limited corrective impact in this context and should be interpreted within the boundaries of controlled experimental modeling.

Dental Traumatology
Çanakkale Onsekiz Mart Üniversitesi (TR)
Peace, Justice and strong institutions
Openalex Percentile: Top 5%
AI in Service Interactions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.