Multi-Level Adaptive Attention Fusion Network for Infrared and Visible Image Fusion

Infrared and visible image fusion involves integrating complementary or critical information extracted from different source images into one image. Due to the significant differences between the two modality features and those across different scales, traditional fusion strategies, such as addition or concatenation, often result in information redundancy or the degradation of crucial information. This letter proposes a multi-level adaptive attention fusion network to adaptively fuse features extracted from different sources. Specifically, we introduced an Adaptive Scale Attention Fusion (ASAF) module that uses a soft selection mechanism to assess the relative importance of different modality features at the same scale and assign corresponding fusion weights. Additionally, a guided upsampling layer is utilized to integrate shallow and deep feature information at different scales in the multi-scale structure. Qualitative and quantitative results on public datasets validate the superior performance of our approach in both visual effects and quantitative metrics.

Authors

Institutions

Publication Details

Journal
IEEE Signal Processing Letters
Published
2024-11-28
DOI
https://doi.org/10.1109/lsp.2024.3509341
Citations
4
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
1.28
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-Level Adaptive Attention Fusion Network for Infrared and Visible Image Fusion

Qing Min Liao, Quan Kong, Ziming Hu
4 citations
IEEE Signal Processing Letters
Advanced Image Fusion Techniques
1.28
article

Multi-Level Adaptive Attention Fusion Network for Infrared and Visible Image Fusion

Qing Min Liao, Quan Kong, Ziming Hu
article en
4 citations

Abstract

Infrared and visible image fusion involves integrating complementary or critical information extracted from different source images into one image. Due to the significant differences between the two modality features and those across different scales, traditional fusion strategies, such as addition or concatenation, often result in information redundancy or the degradation of crucial information. This letter proposes a multi-level adaptive attention fusion network to adaptively fuse features extracted from different sources. Specifically, we introduced an Adaptive Scale Attention Fusion (ASAF) module that uses a soft selection mechanism to assess the relative importance of different modality features at the same scale and assign corresponding fusion weights. Additionally, a guided upsampling layer is utilized to integrate shallow and deep feature information at different scales in the multi-scale structure. Qualitative and quantitative results on public datasets validate the superior performance of our approach in both visual effects and quantitative metrics.

IEEE Signal Processing LettersVol. 32
Wuhan Institute of Technology (CN)
Openalex Percentile: Top 16%
Advanced Image Fusion Techniques
1.28
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.