Wearable smart glasses for first‐person video analysis to evaluate nursing skills: A pilot study with a mixed method design

Abstract Background Comprehensive assessment of skills and performance are necessary to improve the quality of care in nursing education. Various factors pose challenges to accurate assessments, including high student–teacher ratio and observer bias. Objectives To establish an assessment system based on first‐person video of smart glasses and validate its usability and feasibility. Methods We used two cameras (smart glasses for first‐person perspective and a web cam) to perform video analysis for skill and performance assessments. Usability tests were conducted using quantitative and qualitative questionnaires for the usefulness and acceptability of the current assessment system. Data from standardised checklists for three clinical nursing skills (intramuscular injection, endotracheal suction, and Levin tube feeding) were used to analyse the inter‐rater reliability in addition to Fleiss' Kappa coefficient analysis. A total of 22 participants (18 students and 4 reviewers) were recruited. They completed the study. Apart from physical discomfort component, the proposed smart glasses‐based first‐person video assessment system achieved good usability scores from both students and reviewers. Results and Conclusions Fleiss' Kappa values for individual items ranged from 0.450 to 0.808, with an overall average value of 0.592. Results of this study validated the potential of smart glasses‐based assessment system where a set of beneficial mechanisms may meaningfully support the formative learning process. However, issues regarding upgrading the device and need for guidelines for roles of raters and students still remain.