Beyond the Checklist

This study demonstrates the feasibility and reliability of implementing a multi-dimensional clinical CAT. Checklists alone did not accurately assess competency; however, combined with holistic scores, they yielded strong overall inter-rater agreement and more appropriate pass rates for this cohort. These findings support using multiple complementary assessment methods to better identify competent performances. Future steps include refining checklists to focus on critical steps, evaluating bias in holistic scoring, and assessing the CAT over an extended period with a cohort spanning a broader range of expertise.