Cross-Modal Dynamic Feature Fusion for Visible-Infrared Debris Flow Segmentation

Gully type debris flows are sudden, highly destructive geological hazards requiring accurate, real-time monitoring for effective early warning. However, single-modal visual monitoring is sensitive to complex environments, while existing multi-modal fusion approaches rely on static strategies, limiting adaptability and modal complementarity. Blurred boundary segmentation, class imbalance, and real-time deployment challenges also remain unaddressed. To overcome these issues, this study proposes a cross-modal dynamic feature fusion framework integrating visible and infrared imagery, consisting of a shared backbone for multi-scale feature extraction, a dynamic feature aggregation module for adaptive heterogeneous fusion, a lightweight context-aware semantic segmentation network, and a composite loss function to enhance boundary delineation and mitigate class imbalance. Validated on a self-constructed dual-modal debris flow dataset and public benchmarks, the method achieves an mIoU of 75.6%, outperforming state-of-the-art methods by 3.1%. It meets real-time monitoring requirements and exhibits strong generalization, providing a practical solution for debris flow monitoring with great potential for disaster early warning deployment.

Authors

Institutions

Publication Details

Journal
ISPRS International Journal of Geo-Information
Published
2026-05-11
DOI
https://doi.org/10.3390/ijgi15050209
Primary Topic
Landslides and related hazards
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Cross-Modal Dynamic Feature Fusion for Visible-Infrared Debris Flow Segmentation

Chun Bao, Dongri Song, Hongyong Yuan, Rui Li et al.
ISPRS International Journal of Geo-Information
Landslides and related hazards
article

Cross-Modal Dynamic Feature Fusion for Visible-Infrared Debris Flow Segmentation

Chun Bao, Dongri Song, Hongyong Yuan, Rui Li, Zhikun Hu, Mingzhi Zhang
article en

Abstract

Gully type debris flows are sudden, highly destructive geological hazards requiring accurate, real-time monitoring for effective early warning. However, single-modal visual monitoring is sensitive to complex environments, while existing multi-modal fusion approaches rely on static strategies, limiting adaptability and modal complementarity. Blurred boundary segmentation, class imbalance, and real-time deployment challenges also remain unaddressed. To overcome these issues, this study proposes a cross-modal dynamic feature fusion framework integrating visible and infrared imagery, consisting of a shared backbone for multi-scale feature extraction, a dynamic feature aggregation module for adaptive heterogeneous fusion, a lightweight context-aware semantic segmentation network, and a composite loss function to enhance boundary delineation and mitigate class imbalance. Validated on a self-constructed dual-modal debris flow dataset and public benchmarks, the method achieves an mIoU of 75.6%, outperforming state-of-the-art methods by 3.1%. It meets real-time monitoring requirements and exhibits strong generalization, providing a practical solution for debris flow monitoring with great potential for disaster early warning deployment.

ISPRS International Journal of Geo-InformationVol. 15(5)
Shandong University of Technology (CN), Hefei University (CN), Institute of Mountain Hazards and Environment (CN), China Institute of Geological Environmental Monitoring (CN), Tsinghua University (CN)
Chinese Academy of Sciences
Climate action
Openalex Percentile: Top 4%
Landslides and related hazards
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.