Confidence‐Competence Calibration in Early Procedural Skill Acquisition: Evidence from Musculoskeletal Ultrasound Training

OBJECTIVE: We examined relationships among learner-reported outcomes and assessed alignment between confidence and objective examination performance during early MSKUS skill acquisition. METHODS: Learners in the Ultrasound School of North American Rheumatologists Fundamentals program were evaluated in the 2024 and 2025 cohorts. The 8-month program included virtual instruction, standardized scanning protocols, a 3-day hands-on workshop, longitudinal image submission with feedback, and written and practical examinations. Subjective measures included confidence in scanning and interpretation, perceived knowledge, and perceived ability to apply ultrasound in the work setting. Spearman correlations assessed associations among subjective measures and between confidence and continuous examination scores; threshold-sensitivity categorical analyses were secondary. Subjective-objective analyses were limited to 2025 because individual linkage was unavailable for 2024. RESULTS: Among 118 learners, perceived knowledge and ability-to-apply data were available for 93. Linked subjective and written examination data were available for 70; practical scores for 69. Subjective domains were positively associated (knowledge with confidence ⍴ = 0.46, p < 0.001; confidence with ability to apply ⍴ = 0.32, p = 0.007). Confidence was not associated with written performance (⍴ = -0.04, p = 0.74) or practical performance (⍴ = -0.16, p = 0.20) in continuous analyses, and no categorical threshold reached significance (all p ≥ 0.054). Miscalibration was bidirectional: 39% overconfident, 35% underconfident and 26% calibrated. CONCLUSIONS: Among early MSKUS learners, confidence aligned with other learner-reported outcomes but did not discriminate objective competence. This calibration gap suggests that learner- reported readiness should not determine preparedness for independent scanning and supports objective competency assessment.

Authors

Institutions

Publication Details

Journal
Arthritis Care & Research
Published
2026-08-24
DOI
https://doi.org/10.1002/acr.80148
Primary Topic
Ultrasound in Clinical Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Confidence‐Competence Calibration in Early Procedural Skill Acquisition: Evidence from Musculoskeletal Ultrasound Training

Anthony M. Reginato, Minna J. Kohler, N.P. Madsen, Jonathan Samuels et al.
Arthritis Care & Research
Ultrasound in Clinical Applications
article

Confidence‐Competence Calibration in Early Procedural Skill Acquisition: Evidence from Musculoskeletal Ultrasound Training

Anthony M. Reginato, Minna J. Kohler, N.P. Madsen, Jonathan Samuels, Midori Nishio, Jennifer Medlin, Kamini Shah, Shivani Shah, Philip Chu, Catherine Bakewell, Michelene Hearth‐Holmes
article en

Abstract

OBJECTIVE: We examined relationships among learner-reported outcomes and assessed alignment between confidence and objective examination performance during early MSKUS skill acquisition. METHODS: Learners in the Ultrasound School of North American Rheumatologists Fundamentals program were evaluated in the 2024 and 2025 cohorts. The 8-month program included virtual instruction, standardized scanning protocols, a 3-day hands-on workshop, longitudinal image submission with feedback, and written and practical examinations. Subjective measures included confidence in scanning and interpretation, perceived knowledge, and perceived ability to apply ultrasound in the work setting. Spearman correlations assessed associations among subjective measures and between confidence and continuous examination scores; threshold-sensitivity categorical analyses were secondary. Subjective-objective analyses were limited to 2025 because individual linkage was unavailable for 2024. RESULTS: Among 118 learners, perceived knowledge and ability-to-apply data were available for 93. Linked subjective and written examination data were available for 70; practical scores for 69. Subjective domains were positively associated (knowledge with confidence ⍴ = 0.46, p < 0.001; confidence with ability to apply ⍴ = 0.32, p = 0.007). Confidence was not associated with written performance (⍴ = -0.04, p = 0.74) or practical performance (⍴ = -0.16, p = 0.20) in continuous analyses, and no categorical threshold reached significance (all p ≥ 0.054). Miscalibration was bidirectional: 39% overconfident, 35% underconfident and 26% calibrated. CONCLUSIONS: Among early MSKUS learners, confidence aligned with other learner-reported outcomes but did not discriminate objective competence. This calibration gap suggests that learner- reported readiness should not determine preparedness for independent scanning and supports objective competency assessment.

Arthritis Care & Research
Intermountain Healthcare (US), University of Nebraska at Omaha (US), John Muir Health (US), Harvard University (US), Brown University (US), University of Chicago (US), Massachusetts General Hospital (US), Donald & Barbara Zucker School of Medicine at Hofstra/Northwell (US), Duke University Health System (US), University of Rochester (US), New York University (US)
Reduced inequalities
Openalex Percentile: Top 8%
Ultrasound in Clinical Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.