Real‐Time Formative Chairside Evaluation in Orthodontic Clinical Education

Orthodontic residency programs face persistent challenges in delivering consistent, timely, and actionable clinical feedback. Faculty often rely on end-of-session or end-of-rotation grading, limiting case-specific guidance and reducing the impact of feedback. Studies demonstrate that faculty may delay or avoid critical feedback (“failing to fail”), resulting in missed learning opportunities in clinical environments [1, 2]. In addition, variability in evaluation styles across faculty complicates competency development and documentation. Accrediting bodies increasingly require programs to demonstrate measurable progression in patient care, professionalism, and clinical reasoning competencies [3]; however, many current digital evaluation systems are retrospective, time-consuming, or poorly integrated into chairside workflow. Faculty—particularly senior clinicians—may find existing tools cumbersome, reducing adoption and consistency [4]. Importantly, many assessment systems are perceived primarily as grading instruments rather than developmental tools, which may increase learner anxiety and inadvertently discourage formative dialogue. We identified the need for a low-cost, real-time, chairside evaluation system designed explicitly for formative feedback, emphasizing areas for improvement rather than summative grading. The objective of this innovation was to design and implement a minimally disruptive, tablet-based formative assessment system that improves feedback consistency, supports faculty calibration, and enables longitudinal competency tracking in orthodontic clinical education. EvalEvol (a portmanteau of evaluation and evolution, reflecting its purpose as a tool for continuous clinical improvement) is a chairside, tablet-based micro-feedback system designed for real-time clinical use. Each orthodontic operatory is equipped with an inexpensive Android tablet running a web-based interface connected to a secure database backend compatible with institutional systems, such as single sign-on and report export (Figure 1). Following each patient encounter, faculty complete an evaluation in fewer than 20 s using three universal rubric domains: Setup, Technique, and People & Safety. Setup assesses preparation and infection control; Technique addresses procedural accuracy, sequencing, and clinical judgment; People & Safety evaluates communication, professionalism, teamwork, and compliance with OSHA/HIPAA standards. Selecting a rubric opens 3–4 predefined “WHY” chips tailored to the procedure (e.g., moisture control, bracket position, and sequencing). This structure captures both the area of improvement and its underlying cause while minimizing cognitive load. The interface eliminates scrolling and uses large, high-contrast tap targets to accommodate busy clinics and diverse faculty comfort levels with technology. EvalEvol is explicitly not a grading tool. Evaluations are formative, low-stakes, and separated from summative promotion decisions, reinforcing a culture of growth rather than judgment. Audit sampling (random prompts for brief reflective comments in approximately 10% of encounters) Streak detection (alerts when repeated “adequate” ratings suggest missed opportunities for constructive feedback) The customizable rubric domains were developed through iterative faculty consensus and intentionally aligned with CODA competencies and AAC&U VALUE Rubrics domains, including critical thinking, teamwork, and ethical reasoning [3, 5]. This alignment ensures evaluations address cognitive and professional development alongside technical skills. Although designed for orthodontics, the minimalist rubric architecture allows adaptation to other dental and medical specialties. Formal validation is pending; however, formative usability testing demonstrated strong faculty acceptance of the non-scrolling interface and three-domain structure. Faculty reported reduced cognitive load and improved recall when documenting performance immediately chairside, consistent with prior micro-assessment findings [6]. The most significant early challenge was initial hesitation among some senior faculty unfamiliar with tablet-based tools. Brief orientation sessions significantly improved adoption. We also observed early overuse of “adequate” selections, which led to the implementation of streak detection to encourage reflective calibration. Faculty valued the WHY chips for discouraging generic “satisfactory” ratings and promoting a shared vocabulary across evaluators. Alignment with AAC&U VALUE domains supports documentation of cognitive reasoning, teamwork, and ethical development beyond technical output [5]. Implementation planning underscored the importance of clear messaging that the tool is formative, not punitive. Aggregate dashboards will be used for resident progression tracking and faculty calibration rather than summative ranking. A pilot study evaluating inter-faculty consistency, usability metrics, and longitudinal competency trends is planned. Future research will assess reliability and impact on feedback quality. The author declares no conflicts of interest.