Evaluating impact-based forecasting models for tropical cyclone anticipatory action

Impact‐based Forecast (IBF) is increasingly adopted for Anticipatory Action in disaster risk management, yet systematic comparison of the diverse models in use remains limited. To address this gap, we evaluated two existing IBF models that were developed by humanitarian agencies for tropical cyclones in the Philippines and Bangladesh: a statistical machine learning model and an elementary damage curve model. These represent contrasting approaches, systematically characterised with a model card framework across indicators, including data, hazard-impact thresholds, modelling, and decision rules. We used Typhoon Kammuri (2019, the Philippines) as a case study. Both models showed low event-specific accuracy. The statistical model triggered action 81 h before landfall, detecting only 3 % of affected municipalities with a 75 % False Alarm Ratio (FAR). The elementary model adapted for the Philippines context would have triggered 72 h before landfall with a 17 % Probability of Detection (POD) and 40 % FAR. The tropical cyclone forecast uncertainty, particularly high for Kammuri, propagated into the IBF in terms of location and timing. The study also illustrated the influence of parameters such as lead time, trigger threshold, and forecast uncertainty buffer on the model performances, through an interactive portal showcasing the usefulness of such tools in understanding the interplay between indicators. These findings underscore the need for transparent, interpretable IBF frameworks that explicitly communicate uncertainties and trade-offs. The choice between complex and simpler models should be tailored to local data and operational requirements, rather than assuming one approach is generally superior. It requires a statistical analysis of many events. • Compares statistical and elementary methods of Impact-based Forecast (IBF) using the Typhoon Kammuri case study. • Defines indicators of explainability in IBF and applies a model card framework. • Examines trade-offs in modelling choices, lead time and trigger thresholds for Anticipatory Action. • Demonstrates an interactive tool to guide practitioners in model choices.

Authors

Institutions

Publication Details

Journal
International Journal of Disaster Risk Reduction
Published
2025-08-27
DOI
https://doi.org/10.1016/j.ijdrr.2025.105782
Citations
2
Primary Topic
Disaster Management and Resilience
Type
article
Field-Weighted Citation Impact
8.40
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluating impact-based forecasting models for tropical cyclone anticipatory action

Norman Kerle, Marc J. C. Van den Homberg, Sahara Sedhain, Aklilu Teklesadik et al.
2 citations
International Journal of Disaster Risk Reduction
Disaster Management and Resilience
8.40
article

Evaluating impact-based forecasting models for tropical cyclone anticipatory action

Norman Kerle, Marc J. C. Van den Homberg, Sahara Sedhain, Aklilu Teklesadik, Maarten van Aalst
article en
2 citations

Abstract

Impact‐based Forecast (IBF) is increasingly adopted for Anticipatory Action in disaster risk management, yet systematic comparison of the diverse models in use remains limited. To address this gap, we evaluated two existing IBF models that were developed by humanitarian agencies for tropical cyclones in the Philippines and Bangladesh: a statistical machine learning model and an elementary damage curve model. These represent contrasting approaches, systematically characterised with a model card framework across indicators, including data, hazard-impact thresholds, modelling, and decision rules. We used Typhoon Kammuri (2019, the Philippines) as a case study. Both models showed low event-specific accuracy. The statistical model triggered action 81 h before landfall, detecting only 3 % of affected municipalities with a 75 % False Alarm Ratio (FAR). The elementary model adapted for the Philippines context would have triggered 72 h before landfall with a 17 % Probability of Detection (POD) and 40 % FAR. The tropical cyclone forecast uncertainty, particularly high for Kammuri, propagated into the IBF in terms of location and timing. The study also illustrated the influence of parameters such as lead time, trigger threshold, and forecast uncertainty buffer on the model performances, through an interactive portal showcasing the usefulness of such tools in understanding the interplay between indicators. These findings underscore the need for transparent, interpretable IBF frameworks that explicitly communicate uncertainties and trade-offs. The choice between complex and simpler models should be tailored to local data and operational requirements, rather than assuming one approach is generally superior. It requires a statistical analysis of many events. • Compares statistical and elementary methods of Impact-based Forecast (IBF) using the Typhoon Kammuri case study. • Defines indicators of explainability in IBF and applies a model card framework. • Examines trade-offs in modelling choices, lead time and trigger thresholds for Anticipatory Action. • Demonstrates an interactive tool to guide practitioners in model choices.

International Journal of Disaster Risk ReductionVol. 129
Royal Netherlands Meteorological Institute (NL), Red Cross Hospital (GR), University of Twente (NL)
Openalex Percentile: Top 3%
Disaster Management and Resilience
8.40
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.