Applying an after-action review process to examine a complex public health response in New South Wales (NSW), Australia: lessons for reflective practice

Objective After-action reviews (AARs) are used to systematically examine the functions, capabilities and barriers impacting effective pandemic responses. This paper describes the methods used for and the lessons learnt from undertaking the first formal state-wide AAR of the public health response to COVID-19 in New South Wales (NSW), Australia. Type of program A state-wide AAR was applied to examine the public health response to COVID-19 conducted by Health from January 2020 until May 2022. Methods The AAR was conducted between March and November 2022. The World Health Organization ARR approach was used and involved six stages including: (1) AAR design, (2) AAR planning, (3) team debriefs, (4) workshop preparation, (5) consensus workshop and (6) AAR report review and finalisation. Results The AAR process involved over 100 people across the NSW network through surveys, team debriefs and workshops. The stepped process used to complete the review, with standardised templates, was found to be acceptable and feasible. The preparatory stage elicited important insights, provided an opportunity for structured reflection and helped identify themes for discussion in the workshop. Feedback methods included two participant satisfaction surveys and one post-implementation review session, which identified strengths in the process and areas that could be modified for future iterations of other public health reviews in NSW. Lessons learnt The AAR process successfully engaged multi-disciplinary pandemic response staff in a systematic reflection process. The process was perceived by most participants as a highly valuable opportunity to reflect and it led to important findings to improve public health emergency responses. It is important that the scope of the AAR is well understood by participants and that the psychological needs of the workforce are considered in the AAR process. There is merit in applying such reviews as standard practice in future public health emergencies.