PGCFuse: a U-Net-based progressive gated convmixer network with global context aggregation for infrared-visible image fusion

Infrared (IR) and visible (VI) image fusion aims to integrate complementary information from heterogeneous modalities to enhance visual perception in a wide range of applications such as remote sensing, military surveillance, and autonomous driving. While transformer-based and diffusion-driven methods have advanced fusion quality, their computational complexity and resource demands limit practical deployment. Furthermore, combining features in a single step may result in the loss of critical information. To address this, we propose PGCFuse, a novel progressive deep learning framework to fuse VI and IR images. The proposed method employs a multilevel progressive feature extraction strategy to preserve multi-scale spatial features, capturing fine-grained local details and global contextual semantics simultaneously. Unlike single-stream hierarchical approaches, our encoder leverages four parallel streams with progressive downsampling, coupled with a multi-scale spatial attention fusion module to adaptively emphasize salient regions across modalities. In particular, we introduce a Gated Convmixer Block that combines depthwise separable convolutions with gating mechanisms to enhance modality-specific feature representation. An Adaptive Global Feature Aggregation block is introduced that models long-range dependencies to refine feature representations. A nested skip-connected decoder reconstructs the fused image while retaining critical structural and thermal information. Comparative evaluations on the benchmark datasets demonstrate that PGCFuse outperforms recent and SOTA DL-based approaches in fusion quality and computational efficiency.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-05-18
DOI
https://doi.org/10.1038/s41598-026-51313-4
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

PGCFuse: a U-Net-based progressive gated convmixer network with global context aggregation for infrared-visible image fusion

Hamza Mustafa, Muhammad Shehzad Hanif, Syed Farooq Ali, Hafiz Tayyab Mustafa et al.
Scientific Reports
Advanced Image Fusion Techniques
article

PGCFuse: a U-Net-based progressive gated convmixer network with global context aggregation for infrared-visible image fusion

Hamza Mustafa, Muhammad Shehzad Hanif, Syed Farooq Ali, Hafiz Tayyab Mustafa, Mujtaba Asad, Muhammad Bilal
article en

Abstract

Infrared (IR) and visible (VI) image fusion aims to integrate complementary information from heterogeneous modalities to enhance visual perception in a wide range of applications such as remote sensing, military surveillance, and autonomous driving. While transformer-based and diffusion-driven methods have advanced fusion quality, their computational complexity and resource demands limit practical deployment. Furthermore, combining features in a single step may result in the loss of critical information. To address this, we propose PGCFuse, a novel progressive deep learning framework to fuse VI and IR images. The proposed method employs a multilevel progressive feature extraction strategy to preserve multi-scale spatial features, capturing fine-grained local details and global contextual semantics simultaneously. Unlike single-stream hierarchical approaches, our encoder leverages four parallel streams with progressive downsampling, coupled with a multi-scale spatial attention fusion module to adaptively emphasize salient regions across modalities. In particular, we introduce a Gated Convmixer Block that combines depthwise separable convolutions with gating mechanisms to enhance modality-specific feature representation. An Adaptive Global Feature Aggregation block is introduced that models long-range dependencies to refine feature representations. A nested skip-connected decoder reconstructs the fused image while retaining critical structural and thermal information. Comparative evaluations on the benchmark datasets demonstrate that PGCFuse outperforms recent and SOTA DL-based approaches in fusion quality and computational efficiency.

Scientific Reports
Zhejiang Normal University (CN), Shanghai Jiao Tong University (CN), King Abdulaziz University (SA), Università degli studi di Cassino e del Lazio Meridionale (IT), ZheJiang East Crystal Electronic (China) (CN), University of Management and Technology (PK)
Openalex Percentile: Top 5%
Advanced Image Fusion Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.