Deep Learning-based Visible and Infrared Image Fusion using Dual-Branch Attention Network for Enhanced Structural Clarity

This paper presents a deep learning-based framework for the fusion of visible and infrared images to enhance image visibility and structural clarity under varying conditions. The proposed model employs a dual-branch encoder to independently extract features from each modality, followed by a channel attention mechanism to adaptively weight and combine these features. A decoder reconstructs the fused image while preserving essential details from both inputs. The model is trained end-to-end using a composite loss function that emphasizes pixel accuracy, structural similarity, and edge consistency. Experimental evaluations demonstrate that the proposed method achieves superior performance across multiple objective metrics, including MS-SSIM (0.9250), Mutual Information (7.8500), and Entropy (6.1200). Compared to existing techniques such as DTCWT, LatLRR, and NSCT-SR, the proposed model shows significant improvements in structural and perceptual quality. The results confirm the model’s robustness and effectiveness, making it suitable for real-world applications like night vision, surveillance, and autonomous navigation.

Authors

Institutions

Publication Details

Published
2025-06-17
DOI
https://doi.org/10.1109/icicv64824.2025.11085704
Citations
1
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
1.14
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Deep Learning-based Visible and Infrared Image Fusion using Dual-Branch Attention Network for Enhanced Structural Clarity

Chetan J. Awati, R. J. Deshmukh, Sangeeta Jadhav
1 citations
Advanced Image Fusion Techniques
1.14
article

Deep Learning-based Visible and Infrared Image Fusion using Dual-Branch Attention Network for Enhanced Structural Clarity

Chetan J. Awati, R. J. Deshmukh, Sangeeta Jadhav
article en
1 citations

Abstract

This paper presents a deep learning-based framework for the fusion of visible and infrared images to enhance image visibility and structural clarity under varying conditions. The proposed model employs a dual-branch encoder to independently extract features from each modality, followed by a channel attention mechanism to adaptively weight and combine these features. A decoder reconstructs the fused image while preserving essential details from both inputs. The model is trained end-to-end using a composite loss function that emphasizes pixel accuracy, structural similarity, and edge consistency. Experimental evaluations demonstrate that the proposed method achieves superior performance across multiple objective metrics, including MS-SSIM (0.9250), Mutual Information (7.8500), and Entropy (6.1200). Compared to existing techniques such as DTCWT, LatLRR, and NSCT-SR, the proposed model shows significant improvements in structural and perceptual quality. The results confirm the model’s robustness and effectiveness, making it suitable for real-world applications like night vision, surveillance, and autonomous navigation.

Sanjay Ghodawat University (IN)
Openalex Percentile: Top 18%
Advanced Image Fusion Techniques
1.14
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.