Development and validation of an objective skills scoring system for robotic inguinal hernia repairs
Abstract Competency-based surgical education requires objective, scalable assessment of technical skill, yet existing rating scales are subjective. Objective performance indicators (OPIs) derived from console kinematics, offer a solution; however, they lack a validated scoring framework. We developed and externally validated an OPI-based scoring system from robotic transabdominal preperitoneal inguinal hernia repairs performed by 6 attendings and 41 trainees at an academic center (2023–2026). Nineteen OPIs across four tasks were grouped into eight domains, reduced by principal component analysis, and integrated into task-specific 0–100 composite scores via ridge logistic regression. Among 2588 tasks from 392 cases, cross-validated AUCs for attending-trainee discrimination were 0.62–0.74, and composite scores increased from postgraduate year 2 to attending (Spearman ρ, 0.94–1.00; P ≤ 0.005). In an independent external cohort (84 observations, 21 cases), the overall AUC was 0.84 (95% CI, 0.69–0.93). This framework enables objective technical skills assessment in robotic hernia repair.
Authors
- Filippo Filicori (ORCID: https://orcid.org/0000-0001-6874-061X)
- Michael M. Awad (ORCID: https://orcid.org/0000-0002-6065-7050)
- Aditya Amit Godbole (ORCID: https://orcid.org/0000-0003-1674-5034)
- Mattia Ballo (ORCID: https://orcid.org/0000-0002-2356-6627)
- Emaad J. Iqbal (ORCID: https://orcid.org/0000-0003-1129-9127)
- F. Malcher
- Andrew Yee (ORCID: https://orcid.org/0000-0002-4329-3398)
- Blake T Beneville (ORCID: https://orcid.org/0000-0002-4026-0021)
- Maria Clara Morais (ORCID: https://orcid.org/0000-0003-3752-584X)
Publication Details
- Journal
- npj Digital Medicine
- Published
- 2026-10-09
- DOI
- https://doi.org/10.1038/s41746-026-03375-x
- Primary Topic
- Surgical Simulation and Training
- Type
- article
- Field-Weighted Citation Impact
- 0.00