Multimodal retrieval of flood-related remote sensing big data with semantic augmentation from flood events

With the surging adoption of deep learning models, multi-source remote sensing imagery has been increasingly explored to offer a data-driven approach for large-scale flood event analysis and mapping. However, DL-based methods usually suffer from a scarcity of high-quality labeled datasets used for effective model training. Accurately capturing imagery of actual flood-affected areas from massive, dispersed satellite data archives remains significantly challenging under traditional spatiotemporal retrieval paradigms. This challenge arises from insufficient knowledge of flood event semantics, which leads to imprecise spatiotemporal retrieval ranges and difficulty in discriminating flooded areas from permanent water bodies. To address these issues, we propose a semantic-augmented multimodal remote sensing big data retrieval method for analyzing large-scale flood events. It employs a two-phase retrieval strategy: semantic-augmented metadata-based pre-screening across distributed data archives, which refines flood event semantics from the Global Flood Database and Internet news, and DL-enabled multimodal image retrieval for further identification of flood-related imagery, jointly leveraging flood-event-augmented textual semantics and visual features from optical and SAR imagery. Experiments on MFED show that the method achieves an F1-score of 0.965; semantic augmentation improves retrieval accuracy by 11.5%, and multimodal retrieval outperforms single-modality approaches by 28.2%. Across 15 global regions, it reaches 91.2% Top-5 accuracy with a second-level latency.

Authors

Institutions

Publication Details

Journal
Big Earth Data
Published
2026-08-17
DOI
https://doi.org/10.1080/20964471.2026.2689766
Primary Topic
Flood Risk Assessment and Management
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal retrieval of flood-related remote sensing big data with semantic augmentation from flood events

Yan Ma, Peng Liu, Zhixin Zhang, Yixin Zhou
Big Earth Data
Flood Risk Assessment and Management
article

Multimodal retrieval of flood-related remote sensing big data with semantic augmentation from flood events

Yan Ma, Peng Liu, Zhixin Zhang, Yixin Zhou
article en

Abstract

With the surging adoption of deep learning models, multi-source remote sensing imagery has been increasingly explored to offer a data-driven approach for large-scale flood event analysis and mapping. However, DL-based methods usually suffer from a scarcity of high-quality labeled datasets used for effective model training. Accurately capturing imagery of actual flood-affected areas from massive, dispersed satellite data archives remains significantly challenging under traditional spatiotemporal retrieval paradigms. This challenge arises from insufficient knowledge of flood event semantics, which leads to imprecise spatiotemporal retrieval ranges and difficulty in discriminating flooded areas from permanent water bodies. To address these issues, we propose a semantic-augmented multimodal remote sensing big data retrieval method for analyzing large-scale flood events. It employs a two-phase retrieval strategy: semantic-augmented metadata-based pre-screening across distributed data archives, which refines flood event semantics from the Global Flood Database and Internet news, and DL-enabled multimodal image retrieval for further identification of flood-related imagery, jointly leveraging flood-event-augmented textual semantics and visual features from optical and SAR imagery. Experiments on MFED show that the method achieves an F1-score of 0.965; semantic augmentation improves retrieval accuracy by 11.5%, and multimodal retrieval outperforms single-modality approaches by 28.2%. Across 15 global regions, it reaches 91.2% Top-5 accuracy with a second-level latency.

Big Earth Data
Chinese Academy of Sciences (CN), University of Chinese Academy of Sciences (CN)
National Natural Science Foundation of China
Reduced inequalities
Openalex Percentile: Top 12%
Flood Risk Assessment and Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.