Quantifying epistemic uncertainty in deep learning models for quantitative precipitation forecasting using synthetic rainfall fields

Very-short-term quantitative precipitation forecasting (QPF; 0–3 h) is crucial for flood-risk management, but reliability is degraded by data (aleatoric) and model (epistemic) uncertainty. To isolate and quantify the effect of epistemic uncertainty on forecast performance, we generated nine synthetic rainfall fields (three motion types $$\times $$ three intensity evolutions) by rotating an elliptical 2-D Gaussian and trained two convolutional neural network (CNN) QPF models (U-Net and Convolutional Long Short-Term Memory (ConvLSTM)). Monte Carlo Dropout (MCD) was applied to sample predictive distributions. Performance was evaluated using modified Kling–Gupta efficiency (KGE′), Root Mean Squared Error (RMSE), Critical Success Index (CSI), Continuous Ranked Probability Score (CRPS), 95% prediction-interval Coverage and Width, and Error Contribution by Intensity (ECI). Across all cases, deterministic skill ranged from KGE′ 0.83–0.99, CSI 0.90–0.99, and RMSE 0.20–3.18 mm·h−1. U-Net captured structure at short leads but increasingly showed boundary blurring and central overestimation/dispersion, whereas ConvLSTM preserved spatial coherence yet accumulated smoothing with intensity-dependent over/underestimation; ECI indicated a lead-time shift of relative error contribution toward moderate intensities. At t + 1, U-Net achieved CRPS 0.132–0.253 mm·h−1 with Coverage 0.953–0.984 (Width 1.70–3.17 mm·h−1). At t + 6, U-Net became strongly overconfident (Coverage 0.325–0.430; CRPS 0.917–2.069), whereas ConvLSTM maintained higher Coverage (0.623–0.847) and lower CRPS (0.498–0.981 mm·h−1). These findings quantify a sharpness–calibration trade-off in CNN-based QPF and motivate physics-informed constraints, joint aleatoric–epistemic uncertainty modeling, and post-hoc calibration for reliable nowcasting.

Authors

Institutions

Publication Details

Journal
Stochastic Environmental Research and Risk Assessment
Published
2026-05-22
DOI
https://doi.org/10.1007/s00477-026-03230-1
Primary Topic
Precipitation Measurement and Analysis
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Quantifying epistemic uncertainty in deep learning models for quantitative precipitation forecasting using synthetic rainfall fields

Linh Nguyen Van, Younghun Kim, Giang V. Nguyen, Giha Lee et al.
Stochastic Environmental Research and Risk Assessment
Precipitation Measurement and Analysis
article

Quantifying epistemic uncertainty in deep learning models for quantitative precipitation forecasting using synthetic rainfall fields

Linh Nguyen Van, Younghun Kim, Giang V. Nguyen, Giha Lee, Sungho Jung
article en

Abstract

Very-short-term quantitative precipitation forecasting (QPF; 0–3 h) is crucial for flood-risk management, but reliability is degraded by data (aleatoric) and model (epistemic) uncertainty. To isolate and quantify the effect of epistemic uncertainty on forecast performance, we generated nine synthetic rainfall fields (three motion types $$\times $$ three intensity evolutions) by rotating an elliptical 2-D Gaussian and trained two convolutional neural network (CNN) QPF models (U-Net and Convolutional Long Short-Term Memory (ConvLSTM)). Monte Carlo Dropout (MCD) was applied to sample predictive distributions. Performance was evaluated using modified Kling–Gupta efficiency (KGE′), Root Mean Squared Error (RMSE), Critical Success Index (CSI), Continuous Ranked Probability Score (CRPS), 95% prediction-interval Coverage and Width, and Error Contribution by Intensity (ECI). Across all cases, deterministic skill ranged from KGE′ 0.83–0.99, CSI 0.90–0.99, and RMSE 0.20–3.18 mm·h−1. U-Net captured structure at short leads but increasingly showed boundary blurring and central overestimation/dispersion, whereas ConvLSTM preserved spatial coherence yet accumulated smoothing with intensity-dependent over/underestimation; ECI indicated a lead-time shift of relative error contribution toward moderate intensities. At t + 1, U-Net achieved CRPS 0.132–0.253 mm·h−1 with Coverage 0.953–0.984 (Width 1.70–3.17 mm·h−1). At t + 6, U-Net became strongly overconfident (Coverage 0.325–0.430; CRPS 0.917–2.069), whereas ConvLSTM maintained higher Coverage (0.623–0.847) and lower CRPS (0.498–0.981 mm·h−1). These findings quantify a sharpness–calibration trade-off in CNN-based QPF and motivate physics-informed constraints, joint aleatoric–epistemic uncertainty modeling, and post-hoc calibration for reliable nowcasting.

Stochastic Environmental Research and Risk AssessmentVol. 40(6)
Electronics and Telecommunications Research Institute (KR), Kyungpook National University (KR)
Ministry of the Interior and Safety
Climate action
Openalex Percentile: Top 5%
Precipitation Measurement and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.