Development of an evaluation indicator system for intraosseous infusion training based on the Kirkpatrick Model
Intraosseous infusion is a key emergency vascular access technique used in situations where peripheral venous access is difficult, such as in pre-hospital emergency care, emergency rescue operations and the treatment of combat casualties. Whilst relevant training programmes are already in place in China, there remains a lack of systematic tools for evaluating training outcomes, making it difficult to effectively assess the quality of clinical application of this technique following training. To develop an evaluation indicator system for training in intraosseous infusion based on the Kirkpatrick Model, thereby providing a reference for the subsequent development of training evaluation tools and empirical research. This study adopted the Kirkpatrick Model as its theoretical framework. An initial indicator system was developed based on a literature review and group discussions. Two rounds of Delphi expert surveys were conducted with 22 experts in the field of emergency medicine. For the reaction, learning and behaviour levels, quantitative indicators were determined using a percentage weighting method to assign weights to indicators at each level; for the results level, a semi-structured interview guide was finalised following two rounds of expert review. The response rates for the two rounds of expert questionnaires were 73.3 percent and 100% respectively; the expert authority coefficients were 0.883 and 0.877 respectively; and Kendall’s coefficient of concordance was 0.126 and 0.130 respectively ( P < 0.05). The final training evaluation indicator system comprises two parts: quantitative evaluation indicators and qualitative interview guidelines. Specifically, the reaction, learning and behaviour levels collectively comprise 10 first-level indicators, 35 second-level indicators and 63 third-level indicators; the results level contains a semi-structured interview guide comprising three themes and six items. Based on the Kirkpatrick Model and two rounds of expert consultation, this study has developed an evaluation indicator system for training in intraosseous infusion. The system is methodologically rigorous and systematically structured, and can provide a framework for subsequent research into the evaluation of training outcomes; however, its measurement performance, feasibility of implementation and clinical applicability still require further validation.
Authors
- Qianmei Wang (ORCID: https://orcid.org/0000-0001-6876-4371)
- 李军杰
- Peng Zhao (ORCID: https://orcid.org/0000-0002-6559-0289)
- Ting Feng (ORCID: https://orcid.org/0009-0009-6897-3347)
- 胡雪慧
- Yang Wu
- Meimei Ai
- Weiwei Ren
- Peishan Chai
- Jijun Chen
- Qiyu Zhang
Institutions
- Xijing Hospital (CN)
- Air Force Medical University (CN)
Publication Details
- Journal
- BMC Medical Education
- Published
- 2026-11-18
- DOI
- https://doi.org/10.1186/s12909-026-10867-7
- Primary Topic
- Innovations in Medical Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00