Evaluation of Agreement in Denture Quality Assessments Using Videos Recorded with a Mobile Device

Background/Objectives: Information and communication technology is increasingly used for remote oral health assessment. However, evidence regarding video-based assessment of denture quality remains limited. This study aimed to evaluate the agreement between video-based and on-site assessments of denture quality using videos recorded with a mobile device and to examine the inter-rater reliability of video-based assessments among dentists. Methods: Participants were 150 older adults who wore dentures and received routine clinical care at three Showa Medical University hospitals between April 2024 and February 2026. Dentist 1 conducted the on-site assessment and recorded intraoral and extraoral videos using a mobile device. Three dentists independently assessed denture quality from the videos using the modified 5-Defects criteria. Agreement was evaluated using linear weighted Cohen’s kappa, exact agreement, and agreement within ±1 point, with Spearman’s correlation coefficient as a supplementary measure. Inter-rater reliability was assessed using an intraclass correlation coefficient based on a two-way mixed-effects model with absolute agreement. Results: The modified 5-Defects total scores showed good agreement between on-site and video-based assessments for both maxillary and mandibular dentures. Inter-rater reliability among the three video evaluators was also high, with single-measure ICC values of 0.82 (95% CI, 0.77–0.86) and 0.78 (95% CI, 0.72–0.83), respectively. Conclusions: Video-based denture quality assessment using standardized videos recorded by a trained dental team showed good agreement with on-site assessment and high inter-rater reliability among dentists. These findings support the potential of this approach for remote denture assessment by dentists.