MSFE-Net: A Task-Oriented Optical–SAR Fusion Framework for Robust Industrial Object Detection

Object detection in high-resolution remote sensing images under complex industrial environments is fundamentally constrained by the inherent limitations of single-modality sensors. Optical imagery is prone to background confusion and pseudo-target interference, while synthetic aperture radar (SAR) imagery suffers from speckle noise and structural ambiguity. This work investigates a critical evaluation gap in multimodal fusion, where traditional image-level quality metrics do not consistently reflect downstream detection performance. To address this issue, we propose a task-oriented framework termed the Multi-Source Fusion for Enhanced Object Detection Network (MSFE-Net). The proposed method integrates pixel-level optical–SAR fusion with a YOLOv11-based detector, enabling the learning of task-relevant representations by exploiting complementary optical spectral cues and SAR scattering characteristics. Extensive experiments are conducted across multiple fusion strategies and representative detection architectures on two industrial datasets covering oil tanks and photovoltaic arrays. The results consistently reveal a nonlinear decoupling between image-level fusion metrics and detection accuracy, indicating that improvements in global statistical image quality do not necessarily lead to superior task performance. Furthermore, the proposed framework demonstrates improved robustness in complex scenarios involving multi-scale and weak targets. Specifically, MSFE-Net achieves 99.1% mAP@50 for oil tank detection (19.5% improvement over SAR-only baselines) and 90.2% mAP@50 for photovoltaic array detection, with stable performance across different evaluation settings. These results highlight the importance of task-oriented evaluation in multimodal remote sensing fusion and suggest that downstream detection performance provides a more reliable criterion than conventional image-quality metrics.

Authors

Institutions

Publication Details

Journal
Remote Sensing
Published
2026-05-08
DOI
https://doi.org/10.3390/rs18101466
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MSFE-Net: A Task-Oriented Optical–SAR Fusion Framework for Robust Industrial Object Detection

Rong Gui, Pinjun Tang, Jinghui Zhang, LZ Cao et al.
Remote Sensing
Advanced Neural Network Applications
article

MSFE-Net: A Task-Oriented Optical–SAR Fusion Framework for Robust Industrial Object Detection

Rong Gui, Pinjun Tang, Jinghui Zhang, LZ Cao, Jun Hu, Rufeng Guo, Qiao Jiang
article en

Abstract

Object detection in high-resolution remote sensing images under complex industrial environments is fundamentally constrained by the inherent limitations of single-modality sensors. Optical imagery is prone to background confusion and pseudo-target interference, while synthetic aperture radar (SAR) imagery suffers from speckle noise and structural ambiguity. This work investigates a critical evaluation gap in multimodal fusion, where traditional image-level quality metrics do not consistently reflect downstream detection performance. To address this issue, we propose a task-oriented framework termed the Multi-Source Fusion for Enhanced Object Detection Network (MSFE-Net). The proposed method integrates pixel-level optical–SAR fusion with a YOLOv11-based detector, enabling the learning of task-relevant representations by exploiting complementary optical spectral cues and SAR scattering characteristics. Extensive experiments are conducted across multiple fusion strategies and representative detection architectures on two industrial datasets covering oil tanks and photovoltaic arrays. The results consistently reveal a nonlinear decoupling between image-level fusion metrics and detection accuracy, indicating that improvements in global statistical image quality do not necessarily lead to superior task performance. Furthermore, the proposed framework demonstrates improved robustness in complex scenarios involving multi-scale and weak targets. Specifically, MSFE-Net achieves 99.1% mAP@50 for oil tank detection (19.5% improvement over SAR-only baselines) and 90.2% mAP@50 for photovoltaic array detection, with stable performance across different evaluation settings. These results highlight the importance of task-oriented evaluation in multimodal remote sensing fusion and suggest that downstream detection performance provides a more reliable criterion than conventional image-quality metrics.

Remote SensingVol. 18(10)
Central South University (CN)
Industry, innovation and infrastructure
Openalex Percentile: Top 3%
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.