Expert-derived recommendations for designing and facilitating tabletop crisis exercises: A Delphi study

• Identified key goals and common mistakes in discussion-based crisis exercises. • Experts reached consensus on 29 critical factors for effective exercise design. • Clear objectives, quality facilitation, and debriefing were deemed essential. • Disagreement on the importance of exercise fidelity and time constraints. • Provides expert-driven recommendations for improving crisis preparedness exercises. Crises are destabilising, and crisis exercises are one of the core ways that organisations and governments prepare. Not all crisis exercises achieve their goals, and determining how to design them well is difficult to test experimentally. This study aims to identify the key goals of discussion-based crisis exercises, the features of exercises that are important for achieving the organisation’s goals, and common mistakes. We used a three-round Delphi Method to harness the collective expertise of 16 researchers and professionals. In the first round, experts identified 40 different exercise features. After a further two rounds, consensus was achieved for 29 of the 40 exercise features. Overall, experts agreed on the critical importance of clear objectives, good facilitation, and quality debriefing. Experts also agreed that features such as fidelity and the explicit use of decision-making tools were not essential to achieving the aims of discussion-based exercises. There was disagreement amongst experts regarding how much say the sponsor should have, how actively involved facilitators should be, and how accountable responders should be held. Overall, these findings are beneficial for exercise designers in highlighting what features to prioritise when designing and delivering discussion-based exercises to best promote organisational learning.

Authors

Institutions

Publication Details

Journal
Safety Science
Published
2025-05-16
DOI
https://doi.org/10.1016/j.ssci.2025.106898
Citations
5
Primary Topic
Delphi Technique in Research
Type
article
Field-Weighted Citation Impact
21.01
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Expert-derived recommendations for designing and facilitating tabletop crisis exercises: A Delphi study

Michael Noetel, Roger Mason, Simon Reid, Nicolas Widmer et al.
5 citations
Safety Science
Delphi Technique in Research
21.01
article

Expert-derived recommendations for designing and facilitating tabletop crisis exercises: A Delphi study

Michael Noetel, Roger Mason, Simon Reid, Nicolas Widmer, Steven Forrest, Kenny Meesters, Daniel Epstein, Heide Lukosch, Alexander Bollfrass, Sara Waring, Owen Cooper, Keira Wallace
article en
5 citations

Abstract

• Identified key goals and common mistakes in discussion-based crisis exercises. • Experts reached consensus on 29 critical factors for effective exercise design. • Clear objectives, quality facilitation, and debriefing were deemed essential. • Disagreement on the importance of exercise fidelity and time constraints. • Provides expert-driven recommendations for improving crisis preparedness exercises. Crises are destabilising, and crisis exercises are one of the core ways that organisations and governments prepare. Not all crisis exercises achieve their goals, and determining how to design them well is difficult to test experimentally. This study aims to identify the key goals of discussion-based crisis exercises, the features of exercises that are important for achieving the organisation’s goals, and common mistakes. We used a three-round Delphi Method to harness the collective expertise of 16 researchers and professionals. In the first round, experts identified 40 different exercise features. After a further two rounds, consensus was achieved for 29 of the 40 exercise features. Overall, experts agreed on the critical importance of clear objectives, good facilitation, and quality debriefing. Experts also agreed that features such as fidelity and the explicit use of decision-making tools were not essential to achieving the aims of discussion-based exercises. There was disagreement amongst experts regarding how much say the sponsor should have, how actively involved facilitators should be, and how accountable responders should be held. Overall, these findings are beneficial for exercise designers in highlighting what features to prioritise when designing and delivering discussion-based exercises to best promote organisational learning.

Safety ScienceVol. 189
University of Geneva (CH), Australian National University (AU), University of Liverpool (GB), The University of Queensland (AU), University of Canterbury (NZ), University of Hull (GB), Tilburg University (NL), York Technical College (US), ETH Zurich (CH), Monash Health (AU), Monash University (AU)
Openalex Percentile: Top 1%
Delphi Technique in Research
21.01
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.