Limitations of knowledge competency and error patterns in large language models based on orthodontic licensing examinations
The superior performance of DS in standardized exams suggests potential for AI-assisted decision support in orthodontic training and licensing evaluation. However, the persistent factual errors and domain-specific limitations highlight the necessity for clinician verification in real-world applications. Integrating domain-specific knowledge refinement with logical reasoning modules could enhance LLMs' clinical utility in orthodontic practice.
Authors
- Qian Zhao (ORCID: https://orcid.org/0000-0003-4781-6608)
- Lulu Xu (ORCID: https://orcid.org/0000-0001-5527-4680)
- Lili Liu (ORCID: https://orcid.org/0000-0001-7082-4898)
- Feifei Tao (ORCID: https://orcid.org/0000-0002-1526-7723)
- Li Haodi
- Zhang Ruoyan
- Ma Chunkai
Institutions
- Chinese PLA General Hospital (CN)
Publication Details
- Journal
- BMC Oral Health
- Published
- 2025-11-22
- DOI
- https://doi.org/10.1186/s12903-025-07236-z
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.00