Development and Validation of a New Assessment Tool for Simulation-Based Training in Ultrasound-Guided Peripheral Venous Catheterization

Introduction Establishing intravenous access is a common clinical procedure, yet peripheral venous catheter placement can be challenging in certain patient populations. Using ultrasound improves success rates but remains operator-dependent and requires training. Simulation-based training enhances procedural skills without risk to patients but requires a standardized measure of the acquired skills. This study presents and validates a new assessment tool for simulation-based training in ultrasound-guided peripheral venous catheterization, enabling safe transition from simulation to clinical implementation. Methods This exploratory, rater-blinded study recruited participants from two Danish university hospitals. Participants were allocated to one of two groups according to experience level. Each participant performed three ultrasound-guided peripheral venous catheter placements on a phantom. All attempts were video recorded and rated by two blinded raters using the new assessment tool. Validity evidence was examined using Messick's framework, focusing on content validity, response process, internal structure, relationships to other variables, and consequences of testing. Results Fifty participants were enrolled, of whom 46 were included in the final analysis. Internal consistency was high, with an intraclass correlation coefficient (ICC) of 0.85. The tool effectively discriminated between novices and experienced participants (p < 0.001). A pass/fail score of 18 points was established, with a false-negative rate of 4.5% and a false-positive rate of 12.5%. Conclusion We found the new assessment tool valid and reliable, effectively distinguishing novices from experienced participants and setting a passing cutoff score. This supports its use in simulation-based training to standardize competence evaluation, serving as a gateway to subsequent assessment in clinical practice.