Assessing the Role of Large Language Models in Veterinary Dentistry Client Communication

This study evaluated the accuracy, consistency, and clinical appropriateness of responses generated by large language models (LLMs) to frequently asked questions (FAQs) in veterinary dentistry client communication. Six common FAQs were identified based on guidance from the American Veterinary Dental College (AVDC) and submitted under standardized conditions to multiple LLMs, including ChatGPT-5, Gemini 2.5 Flash, Claude Sonnet 4.5, Perplexity, Qwen3-Max, and DeepSeek. Artificial intelligence (AI) generated responses were compared with expert-reviewed reference answers prepared by 2 veterinarians with academic and clinical experience in small animal dentistry. Responses were independently evaluated by 2 expert and 2 novice assessors across 4 domains: main idea coverage, information quality, consistency with expert content, and presence of inconsistencies using a 3-point Likert scale (Yes, Neutral, No). Inter-rater agreement between expert evaluators was assessed using Cohen's kappa, and between-model comparisons were performed using McNemar's exact test after dichotomization of ratings. Inter-rater agreement was substantial (κ = 0.68). ChatGPT-5 showed the highest alignment with expert-reviewed reference content, followed by Claude Sonnet 4.5. Differences between expert and novice evaluations were most evident for questions related to anesthesia safety and anesthesia-free dental procedures. Clinically relevant inaccuracies were identified across several models, particularly regarding the requirement for general anesthesia with a protected airway. No statistically significant differences were detected between primary model comparisons (<i>P</i> = 1.00). These findings indicate that LLMs may support client education in veterinary dentistry but require expert oversight to ensure clinical accuracy and patient safety.

Authors

Institutions

Publication Details

Journal
Journal of Veterinary Dentistry
Published
2026-02-18
DOI
https://doi.org/10.1177/08987564261424454
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Assessing the Role of Large Language Models in Veterinary Dentistry Client Communication

Sıtkıcan Okur, Büşra Baykal
Journal of Veterinary Dentistry
Artificial Intelligence in Healthcare and Education
article

Assessing the Role of Large Language Models in Veterinary Dentistry Client Communication

Sıtkıcan Okur, Büşra Baykal
article en

Abstract

This study evaluated the accuracy, consistency, and clinical appropriateness of responses generated by large language models (LLMs) to frequently asked questions (FAQs) in veterinary dentistry client communication. Six common FAQs were identified based on guidance from the American Veterinary Dental College (AVDC) and submitted under standardized conditions to multiple LLMs, including ChatGPT-5, Gemini 2.5 Flash, Claude Sonnet 4.5, Perplexity, Qwen3-Max, and DeepSeek. Artificial intelligence (AI) generated responses were compared with expert-reviewed reference answers prepared by 2 veterinarians with academic and clinical experience in small animal dentistry. Responses were independently evaluated by 2 expert and 2 novice assessors across 4 domains: main idea coverage, information quality, consistency with expert content, and presence of inconsistencies using a 3-point Likert scale (Yes, Neutral, No). Inter-rater agreement between expert evaluators was assessed using Cohen's kappa, and between-model comparisons were performed using McNemar's exact test after dichotomization of ratings. Inter-rater agreement was substantial (κ = 0.68). ChatGPT-5 showed the highest alignment with expert-reviewed reference content, followed by Claude Sonnet 4.5. Differences between expert and novice evaluations were most evident for questions related to anesthesia safety and anesthesia-free dental procedures. Clinically relevant inaccuracies were identified across several models, particularly regarding the requirement for general anesthesia with a protected airway. No statistically significant differences were detected between primary model comparisons (<i>P</i> = 1.00). These findings indicate that LLMs may support client education in veterinary dentistry but require expert oversight to ensure clinical accuracy and patient safety.

Journal of Veterinary Dentistry
Atatürk University (TR)
Quality Education
Openalex Percentile: Top 53%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.