HaarFuse: A dual-branch infrared and visible light image fusion network based on Haar wavelet transform

Infrared-visible image fusion remains challenging due to the inherent conflict between preserving multi-modal complementary features and minimizing reconstruction loss. Existing methods often suffer from inadequate feature representation and information degradation during fusion. To address this, we propose HaarFuse, a wavelet-enhanced auto-encoder network that hierarchically integrates multi-scale features for robust fusion. The network first employs wavelet transform to extend the receptive field of convolutional layers, extracting shared shallow features that encode both low-frequency structural contours and high-frequency texture primitives. Subsequently, the shallow features are decomposed into high-frequency and low-frequency components through Haar wavelet transform, and techniques such as INN, Gabor layer, and Transformer are adopted to further optimize and process these features. Finally, the fused image is reconstructed via the inverse wavelet transform. Experiments on TNO, MSRS, and M3FD benchmarks validate HaarFuse's superiority: it achieves the highest thermal saliency (SD=45.78, +5.5%↑ on MSRS; EN=6.98, +4.0%↑ on M3FD), optimal edge fidelity (Qabf=0.62, +1.6%↑ on M3FD), and 34.2 × faster inference than SwinFusion with 0.468MB parameters. Further validation in machine vision and medical imaging confirms its robustness for real-time applications.

Authors

Institutions

Publication Details

Journal
Pattern Recognition
Published
2025-03-11
DOI
https://doi.org/10.1016/j.patcog.2025.111594
Citations
19
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
21.57

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

HaarFuse: A dual-branch infrared and visible light image fusion network based on Haar wavelet transform

Leqiang Yang, Jianli Wang, Jie Liu, Yuequn Wang et al.
19 citations
Pattern Recognition
Advanced Image Fusion Techniques
21.57
article

HaarFuse: A dual-branch infrared and visible light image fusion network based on Haar wavelet transform

Leqiang Yang, Jianli Wang, Jie Liu, Yuequn Wang, Zhengwei Li, Bo Dong
article en
19 citations

Abstract

Infrared-visible image fusion remains challenging due to the inherent conflict between preserving multi-modal complementary features and minimizing reconstruction loss. Existing methods often suffer from inadequate feature representation and information degradation during fusion. To address this, we propose HaarFuse, a wavelet-enhanced auto-encoder network that hierarchically integrates multi-scale features for robust fusion. The network first employs wavelet transform to extend the receptive field of convolutional layers, extracting shared shallow features that encode both low-frequency structural contours and high-frequency texture primitives. Subsequently, the shallow features are decomposed into high-frequency and low-frequency components through Haar wavelet transform, and techniques such as INN, Gabor layer, and Transformer are adopted to further optimize and process these features. Finally, the fused image is reconstructed via the inverse wavelet transform. Experiments on TNO, MSRS, and M3FD benchmarks validate HaarFuse's superiority: it achieves the highest thermal saliency (SD=45.78, +5.5%↑ on MSRS; EN=6.98, +4.0%↑ on M3FD), optimal edge fidelity (Qabf=0.62, +1.6%↑ on M3FD), and 34.2 × faster inference than SwinFusion with 0.468MB parameters. Further validation in machine vision and medical imaging confirms its robustness for real-time applications.

Pattern RecognitionVol. 164
Changchun Institute of Optics, Fine Mechanics and Physics (CN)
Key Technologies Research and Development Program, National Key Research and Development Program of China
Openalex Percentile: Top 1%
Advanced Image Fusion Techniques
21.57
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

HaarFuse: A dual-branch infrared and visible light image fusion network based on Haar wavelet transform — Leqiang Yang, Jianli Wang, et al. · Pattern Recognition (2025) | TGRS Research Map | TGRS