LB-CIM: Low-Bandwidth Cross-Modal Interaction for Multimodal Visible-SAR Object Detection

Visible and synthetic aperture radar (SAR) sensors provide heterogeneous yet complementary observations for remote-sensing object detection. However, effective multimodal sensing fusion remains challenging because SAR features may contain locally unstable responses, while dense cross-modal interaction can introduce redundant information exchange and unnecessary computation. This paper presents LB-CIM, a low-bandwidth cross-modal interaction module for paired VIS–SAR object detection. LB-CIM adopts a three-stage design. First, multi-scale consistency denoising (MCD) estimates local SAR instability from cross-scale discrepancies and suppresses inconsistent responses before fusion. Second, differential low-bandwidth cross-attention (DLBCA) performs bidirectional interaction using queries at the unreduced interaction-grid resolution and spatially reduced key–value representations, while differential values and difference-aware gating emphasize non-redundant cross-modal information. Third, consensus-complementary enhancement (CCE) separates shared and complementary cues and adaptively reorganizes them to form the fused representation. LB-CIM is inserted at multiple feature levels of a dual-branch detector. Experiments on OGSOD-1.0 and SpaceNet6-OTD-Fog demonstrate consistent improvements over single-modal and multimodal baselines. On OGSOD-1.0, the proposed model achieves 95.1% mAP50 and 56.8% mAP50:95, improving the YOLO11-RGBT baseline by 4.8 and 4.7 percentage points, respectively. On SpaceNet6-OTD-Fog, it reaches 70.6% mAP50 and 38.5% mAP50:95, corresponding to gains of 2.7 and 2.0 percentage points. Ablation experiments confirm the complementary contributions of MCD, DLBCA, and CCE, while evaluations on YOLOv5n, YOLOv8n, and YOLO11n-based detectors show that the gains are maintained across different YOLO architectures. The complete model contains 4.6 M parameters and requires 10.4 GFLOPs, providing a favorable balance between detection accuracy and computational complexity. Qualitative comparisons further show fewer missed detections and false positives under diverse target densities and scene structures. These results demonstrate that LB-CIM provides an effective and computationally efficient solution for multimodal sensing representation learning and VIS–SAR information fusion in remote-sensing vision tasks.

Authors

Institutions

Publication Details

Journal
Sensors
Published
2026-11-09
DOI
https://doi.org/10.3390/s26217078
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

LB-CIM: Low-Bandwidth Cross-Modal Interaction for Multimodal Visible-SAR Object Detection

Xiangyu Peng, Xinrong Wang, Yang Li, Kejia Zhang
Sensors
Advanced Neural Network Applications
article

LB-CIM: Low-Bandwidth Cross-Modal Interaction for Multimodal Visible-SAR Object Detection

Xiangyu Peng, Xinrong Wang, Yang Li, Kejia Zhang
article en

Abstract

Visible and synthetic aperture radar (SAR) sensors provide heterogeneous yet complementary observations for remote-sensing object detection. However, effective multimodal sensing fusion remains challenging because SAR features may contain locally unstable responses, while dense cross-modal interaction can introduce redundant information exchange and unnecessary computation. This paper presents LB-CIM, a low-bandwidth cross-modal interaction module for paired VIS–SAR object detection. LB-CIM adopts a three-stage design. First, multi-scale consistency denoising (MCD) estimates local SAR instability from cross-scale discrepancies and suppresses inconsistent responses before fusion. Second, differential low-bandwidth cross-attention (DLBCA) performs bidirectional interaction using queries at the unreduced interaction-grid resolution and spatially reduced key–value representations, while differential values and difference-aware gating emphasize non-redundant cross-modal information. Third, consensus-complementary enhancement (CCE) separates shared and complementary cues and adaptively reorganizes them to form the fused representation. LB-CIM is inserted at multiple feature levels of a dual-branch detector. Experiments on OGSOD-1.0 and SpaceNet6-OTD-Fog demonstrate consistent improvements over single-modal and multimodal baselines. On OGSOD-1.0, the proposed model achieves 95.1% mAP50 and 56.8% mAP50:95, improving the YOLO11-RGBT baseline by 4.8 and 4.7 percentage points, respectively. On SpaceNet6-OTD-Fog, it reaches 70.6% mAP50 and 38.5% mAP50:95, corresponding to gains of 2.7 and 2.0 percentage points. Ablation experiments confirm the complementary contributions of MCD, DLBCA, and CCE, while evaluations on YOLOv5n, YOLOv8n, and YOLO11n-based detectors show that the gains are maintained across different YOLO architectures. The complete model contains 4.6 M parameters and requires 10.4 GFLOPs, providing a favorable balance between detection accuracy and computational complexity. Qualitative comparisons further show fewer missed detections and false positives under diverse target densities and scene structures. These results demonstrate that LB-CIM provides an effective and computationally efficient solution for multimodal sensing representation learning and VIS–SAR information fusion in remote-sensing vision tasks.

SensorsVol. 26(21)
Harbin Engineering University (CN), Wuhan University (CN), Beijing University of Technology (CN)
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon