SRS329 - Assessment of construct validity of an artificial temporal bone model used for mastoidectomy skill development in otolaryngology

Abstract Introduction Growing limitations concerning the use of human cadaveric temporal bones for mastoidectomy training has created the demand for valid substitutes. Synthetic 3D-printed dry temporal bone models are hypothesised to be suitable alternatives, however there is paucity of research assessing their validity for realistic surgical dissection. This study aims to assess the construct validity of an artificial temporal bone model (ATBM) regularly used for mastoidectomy skill development. Methods This study retrospectively evaluated construct validity of the ATBM used by trainees on the West Midlands otolaryngological specialty training programme. Trainees were categorised into three groups according to grade of training. Participants performed a mastoidectomy procedure using the MED-EL ATBM, with performance assessed using a modified Objective Structured Assessment of Technical Skill specific to mastoidectomy dissection. Results The study population consisted of 41 participants: 12 junior (ST1-3), 14 intermediate (ST4-6) and 15 senior (ST7-8 and post-certification fellows) trainees. The intermediate and senior cohorts demonstrated significantly higher mean mastoidectomy performance scores compared to the junior cohort (P < 0.001 for both comparisons). There was no significant difference in scores between the intermediate and senior cohorts (P = 2.72). Conclusions This ATBM was able to discriminate trainee performance between junior participants versus those in specialist training year 4 or above, demonstrating construct validity for early years skills training. It was unable to discrimate between intermediate versus senior trainees. With ongoing development of new ATBMs, research is required to assess their construct validity and understand if and when best to use them for mastoidectomy skill development.