Evaluating flood-susceptibility models under leakage-controlled spatial validation in Yeoju, Republic of Korea

Random cell-level validation can overestimate flood-susceptibility discrimination when nearby cells share inundation features. We assessed this effect in Yeoju, Republic of Korea, using 2,000 flood polygons from 2006 and 2013, 82 leakage-control groups, 12 static factors and nine models. Five repeats of five-fold grouped spatial validation yielded lower AUCs than random hold-outs, with differences of 0.017–0.136. GAT achieved the highest mean out-of-fold AUC (0.951 ± 0.012 SD), although this ranking remains conditional on the study region and implementations. Sensitivity experiments examined fold count, spatial grouping, buffering, predictor encoding and graph construction. Additional metrics assessed classification, calibration and agreement with inventory labels. Associations between prediction dispersion and score–label discrepancy depended on class composition: RGCN and random forest showed negative correlations within mapped flood cells, whereas XGBoost showed a negative whole-raster correlation. These findings demonstrate that validation design, predictor representation and class composition influence model assessment. They support grouped spatial evaluation for screening spatially withheld areas within Yeoju and class-specific checks before interpreting dispersion as an instability warning.

Authors

Publication Details

Journal
Figshare
Published
2026-11-19
DOI
https://doi.org/10.6084/m9.figshare.35059068
Primary Topic
Flood Risk Assessment and Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Evaluating flood-susceptibility models under leakage-controlled spatial validation in Yeoju, Republic of Korea

이우진, Sooyeon Han, Saro Lee
Figshare
Flood Risk Assessment and Management
article

Evaluating flood-susceptibility models under leakage-controlled spatial validation in Yeoju, Republic of Korea

이우진, Sooyeon Han, Saro Lee
article en

Abstract

Random cell-level validation can overestimate flood-susceptibility discrimination when nearby cells share inundation features. We assessed this effect in Yeoju, Republic of Korea, using 2,000 flood polygons from 2006 and 2013, 82 leakage-control groups, 12 static factors and nine models. Five repeats of five-fold grouped spatial validation yielded lower AUCs than random hold-outs, with differences of 0.017–0.136. GAT achieved the highest mean out-of-fold AUC (0.951 ± 0.012 SD), although this ranking remains conditional on the study region and implementations. Sensitivity experiments examined fold count, spatial grouping, buffering, predictor encoding and graph construction. Additional metrics assessed classification, calibration and agreement with inventory labels. Associations between prediction dispersion and score–label discrepancy depended on class composition: RGCN and random forest showed negative correlations within mapped flood cells, whereas XGBoost showed a negative whole-raster correlation. These findings demonstrate that validation design, predictor representation and class composition influence model assessment. They support grouped spatial evaluation for screening spatially withheld areas within Yeoju and class-specific checks before interpreting dispersion as an instability warning.

Figshare
Flood Risk Assessment and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon