PGCFuse: a U-Net-based progressive gated convmixer network with global context aggregation for infrared-visible image fusion
Infrared (IR) and visible (VI) image fusion aims to integrate complementary information from heterogeneous modalities to enhance visual perception in a wide range of applications such as remote sensing, military surveillance, and autonomous driving. While transformer-based and diffusion-driven methods have advanced fusion quality, their computational complexity and resource demands limit practical deployment. Furthermore, combining features in a single step may result in the loss of critical information. To address this, we propose PGCFuse, a novel progressive deep learning framework to fuse VI and IR images. The proposed method employs a multilevel progressive feature extraction strategy to preserve multi-scale spatial features, capturing fine-grained local details and global contextual semantics simultaneously. Unlike single-stream hierarchical approaches, our encoder leverages four parallel streams with progressive downsampling, coupled with a multi-scale spatial attention fusion module to adaptively emphasize salient regions across modalities. In particular, we introduce a Gated Convmixer Block that combines depthwise separable convolutions with gating mechanisms to enhance modality-specific feature representation. An Adaptive Global Feature Aggregation block is introduced that models long-range dependencies to refine feature representations. A nested skip-connected decoder reconstructs the fused image while retaining critical structural and thermal information. Comparative evaluations on the benchmark datasets demonstrate that PGCFuse outperforms recent and SOTA DL-based approaches in fusion quality and computational efficiency.
Authors
- Hamza Mustafa (ORCID: https://orcid.org/0000-0003-3610-2888)
- Muhammad Shehzad Hanif (ORCID: https://orcid.org/0000-0002-6316-9677)
- Syed Farooq Ali (ORCID: https://orcid.org/0000-0003-3943-903X)
- Hafiz Tayyab Mustafa (ORCID: https://orcid.org/0000-0003-3992-4457)
- Mujtaba Asad
- Muhammad Bilal
Institutions
- Zhejiang Normal University (CN)
- Shanghai Jiao Tong University (CN)
- King Abdulaziz University (SA)
- Università degli studi di Cassino e del Lazio Meridionale (IT)
- ZheJiang East Crystal Electronic (China) (CN)
- University of Management and Technology (PK)
Publication Details
- Journal
- Scientific Reports
- Published
- 2026-05-18
- DOI
- https://doi.org/10.1038/s41598-026-51313-4
- Primary Topic
- Advanced Image Fusion Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00