MCDFus: visible and infrared image fusion via Mamba-CNN for enhanced UAV perception

Visible and infrared image fusion (VIF) is essential for unmanned aerial vehicle (UAV) perception by integrating complementary information from heterogeneous sensors to enhance understanding in complex environments. Existing deep learning-based VIF methods often face a trade-off between the limited receptive fields of CNNs and the high computational overhead of Transformers. Although Mamba shows great potential in modeling long-range dependencies with linear complexity, it struggles to preserve spatial information in complex spatial correlations. Moreover, most VIF methods lack effective multimodal feature disentanglement, which is particularly challenging in low-light and cluttered backgrounds. To address these challenges, we propose MCDFuse, a novel Mamba-CNN-driven VIF framework that synergistically combines the strengths of Mamba and CNN architectures. We introduce a dynamic feature activation module to improve spatial modeling and facilitate high-quality image reconstruction. A dual-branch architecture integrates ConvNeXt modules to expand the receptive field and inverted residual blocks to enhance detail representation. Furthermore, a feature decomposition loss with normalization constraints is designed to optimize feature disentanglement during training. Comparative experiments on multiple datasets, including newly constructed ones, against 12 state-of-the-art methods demonstrate that our approach achieves superior fusion quality and improves performance on downstream object detection tasks. The dataset can be downloaded from https://github.com/MCDFuse/UAVScene .

Institutions

Publication Details

Journal
Multimedia Systems
Published
2025-12-04
DOI
https://doi.org/10.1007/s00530-025-02080-1
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MCDFus: visible and infrared image fusion via Mamba-CNN for enhanced UAV perception

Multimedia Systems
Advanced Image Fusion Techniques
article

MCDFus: visible and infrared image fusion via Mamba-CNN for enhanced UAV perception

article en

Abstract

Visible and infrared image fusion (VIF) is essential for unmanned aerial vehicle (UAV) perception by integrating complementary information from heterogeneous sensors to enhance understanding in complex environments. Existing deep learning-based VIF methods often face a trade-off between the limited receptive fields of CNNs and the high computational overhead of Transformers. Although Mamba shows great potential in modeling long-range dependencies with linear complexity, it struggles to preserve spatial information in complex spatial correlations. Moreover, most VIF methods lack effective multimodal feature disentanglement, which is particularly challenging in low-light and cluttered backgrounds. To address these challenges, we propose MCDFuse, a novel Mamba-CNN-driven VIF framework that synergistically combines the strengths of Mamba and CNN architectures. We introduce a dynamic feature activation module to improve spatial modeling and facilitate high-quality image reconstruction. A dual-branch architecture integrates ConvNeXt modules to expand the receptive field and inverted residual blocks to enhance detail representation. Furthermore, a feature decomposition loss with normalization constraints is designed to optimize feature disentanglement during training. Comparative experiments on multiple datasets, including newly constructed ones, against 12 state-of-the-art methods demonstrate that our approach achieves superior fusion quality and improves performance on downstream object detection tasks. The dataset can be downloaded from https://github.com/MCDFuse/UAVScene .

Multimedia SystemsVol. 32(1)
Naval University of Engineering (CN)
Openalex Percentile: Top 36%
Advanced Image Fusion Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.