Evaluating flood-susceptibility models under leakage-controlled spatial validation in Yeoju, Republic of Korea

Random cell-level validation can overestimate flood-susceptibility discrimination when nearby cells share inundation features. We assessed this effect in Yeoju, Republic of Korea, using 2,000 flood polygons from 2006 and 2013, 82 leakage-control groups, 12 static factors and nine models. Five repeats of five-fold grouped spatial validation yielded lower AUCs than random hold-outs, with differences of 0.017–0.136. GAT achieved the highest mean out-of-fold AUC (0.951 ± 0.012 SD), although this ranking remains conditional on the study region and implementations. Sensitivity experiments examined fold count, spatial grouping, buffering, predictor encoding and graph construction. Additional metrics assessed classification, calibration and agreement with inventory labels. Associations between prediction dispersion and score–label discrepancy depended on class composition: RGCN and random forest showed negative correlations within mapped flood cells, whereas XGBoost showed a negative whole-raster correlation. These findings demonstrate that validation design, predictor representation and class composition influence model assessment. They support grouped spatial evaluation for screening spatially withheld areas within Yeoju and class-specific checks before interpreting dispersion as an instability warning.

Authors

Institutions

Publication Details

Journal
Geomatics Natural Hazards and Risk
Published
2026-11-19
DOI
https://doi.org/10.1080/19475705.2026.2764487
Primary Topic
Flood Risk Assessment and Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Evaluating flood-susceptibility models under leakage-controlled spatial validation in Yeoju, Republic of Korea

Saro Lee, Sooyeon Han, Woojin Lee
Geomatics Natural Hazards and Risk
Flood Risk Assessment and Management
article

Evaluating flood-susceptibility models under leakage-controlled spatial validation in Yeoju, Republic of Korea

Saro Lee, Sooyeon Han, Woojin Lee
article en

Abstract

Random cell-level validation can overestimate flood-susceptibility discrimination when nearby cells share inundation features. We assessed this effect in Yeoju, Republic of Korea, using 2,000 flood polygons from 2006 and 2013, 82 leakage-control groups, 12 static factors and nine models. Five repeats of five-fold grouped spatial validation yielded lower AUCs than random hold-outs, with differences of 0.017–0.136. GAT achieved the highest mean out-of-fold AUC (0.951 ± 0.012 SD), although this ranking remains conditional on the study region and implementations. Sensitivity experiments examined fold count, spatial grouping, buffering, predictor encoding and graph construction. Additional metrics assessed classification, calibration and agreement with inventory labels. Associations between prediction dispersion and score–label discrepancy depended on class composition: RGCN and random forest showed negative correlations within mapped flood cells, whereas XGBoost showed a negative whole-raster correlation. These findings demonstrate that validation design, predictor representation and class composition influence model assessment. They support grouped spatial evaluation for screening spatially withheld areas within Yeoju and class-specific checks before interpreting dispersion as an instability warning.

Geomatics Natural Hazards and RiskVol. 17(1)
Dongguk University (KR), Korea Institute of Geoscience and Mineral Resources (KR)
Flood Risk Assessment and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon