Development of an evaluation indicator system for intraosseous infusion training based on the Kirkpatrick Model

Intraosseous infusion is a key emergency vascular access technique used in situations where peripheral venous access is difficult, such as in pre-hospital emergency care, emergency rescue operations and the treatment of combat casualties. Whilst relevant training programmes are already in place in China, there remains a lack of systematic tools for evaluating training outcomes, making it difficult to effectively assess the quality of clinical application of this technique following training. To develop an evaluation indicator system for training in intraosseous infusion based on the Kirkpatrick Model, thereby providing a reference for the subsequent development of training evaluation tools and empirical research. This study adopted the Kirkpatrick Model as its theoretical framework. An ​initial indicator system was developed based on a literature review and group discussions. Two rounds of Delphi expert surveys were conducted with 22 experts in the field of emergency medicine. For the reaction, learning and behaviour levels, quantitative indicators were determined using a percentage weighting method to assign weights to indicators at each level; for the results level, a semi-structured interview guide was finalised following two rounds of expert review. The response rates for the two rounds of expert questionnaires were 73.3 per​cent and 100% respectively; the expert authority coefficients were 0.883 and 0.877 respectively; and Kendall’s coefficient of concordance was 0.126 and 0.130 respectively ( P < 0.05). The final training evaluation indicator system comprises two parts: ​quantitative evaluation indicators and qualitative interview guidelines. Specifically, the​ reaction, learning and behaviour levels collectively comprise 10 first-level indicators, 35 second-level indicators and 63 third-level indicators; the results level contains a semi-structured interview guide comprising three themes and six items. Based on the Kirkpatrick Model and two rounds of expert consultation, this study has developed an evaluation indicator system for training in intraosseous infusion. The system is methodologically rigorous and systematically structured, and can provide a framework for subsequent research into the evaluation of training outcomes; however, its measurement performance, feasibility of implementation and clinical applicability still require further validation.

Authors

Institutions

Publication Details

Journal
BMC Medical Education
Published
2026-11-18
DOI
https://doi.org/10.1186/s12909-026-10867-7
Primary Topic
Innovations in Medical Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Development of an evaluation indicator system for intraosseous infusion training based on the Kirkpatrick Model

Qianmei Wang, 李军杰, Peng Zhao, Ting Feng et al.
BMC Medical Education
Innovations in Medical Education
article

Development of an evaluation indicator system for intraosseous infusion training based on the Kirkpatrick Model

Qianmei Wang, 李军杰, Peng Zhao, Ting Feng, 胡雪慧, Yang Wu, Meimei Ai, Weiwei Ren, Peishan Chai, Jijun Chen, Qiyu Zhang
article en

Abstract

Intraosseous infusion is a key emergency vascular access technique used in situations where peripheral venous access is difficult, such as in pre-hospital emergency care, emergency rescue operations and the treatment of combat casualties. Whilst relevant training programmes are already in place in China, there remains a lack of systematic tools for evaluating training outcomes, making it difficult to effectively assess the quality of clinical application of this technique following training. To develop an evaluation indicator system for training in intraosseous infusion based on the Kirkpatrick Model, thereby providing a reference for the subsequent development of training evaluation tools and empirical research. This study adopted the Kirkpatrick Model as its theoretical framework. An ​initial indicator system was developed based on a literature review and group discussions. Two rounds of Delphi expert surveys were conducted with 22 experts in the field of emergency medicine. For the reaction, learning and behaviour levels, quantitative indicators were determined using a percentage weighting method to assign weights to indicators at each level; for the results level, a semi-structured interview guide was finalised following two rounds of expert review. The response rates for the two rounds of expert questionnaires were 73.3 per​cent and 100% respectively; the expert authority coefficients were 0.883 and 0.877 respectively; and Kendall’s coefficient of concordance was 0.126 and 0.130 respectively ( P < 0.05). The final training evaluation indicator system comprises two parts: ​quantitative evaluation indicators and qualitative interview guidelines. Specifically, the​ reaction, learning and behaviour levels collectively comprise 10 first-level indicators, 35 second-level indicators and 63 third-level indicators; the results level contains a semi-structured interview guide comprising three themes and six items. Based on the Kirkpatrick Model and two rounds of expert consultation, this study has developed an evaluation indicator system for training in intraosseous infusion. The system is methodologically rigorous and systematically structured, and can provide a framework for subsequent research into the evaluation of training outcomes; however, its measurement performance, feasibility of implementation and clinical applicability still require further validation.

BMC Medical Education
Xijing Hospital (CN), Air Force Medical University (CN)
Good health and well-being
Innovations in Medical Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon