Multi-Scale Frequency-Aware Representation Learning for Infrared and Visible Image Fusion
Infrared and visible image fusion aims to integrate complementary information from heterogeneous sensors for remote sensing and Earth-observation applications. To achieve a better balance between global contextual modeling and local structural preservation, we propose MSF-Net, a multi-scale frequency-aware fusion network with a hierarchical design. The proposed framework consists of two main stages: multi-scale feature extraction with frequency-domain interaction and hierarchical cross-modal fusion. Specifically, a hybrid spatial-frequency encoding block (HSFEB) is designed as the basic building unit, which combines a spatial-frequency interaction module (SFIM) for global context aggregation in the frequency domain and a structure-guided feature refinement module (SGFRM) for preserving local structural details. In addition, a hierarchical feature fusion module (HFFM) is introduced to progressively integrate cross-modal and cross-scale features in a coarse-to-fine manner. A joint loss function, composed of intensity and structural constraints, is adopted to supervise the fusion process. Extensive experiments on three public benchmarks, MSRS, M3FD, and TNO, demonstrate that MSF-Net achieves superior performance over nine SOTA methods in both qualitative and quantitative evaluations. The results show that the proposed method effectively enhances thermal targets, preserves structural details, and maintains good visual naturalness under diverse remote-sensing scenarios.
Authors
- Liye Mei (ORCID: https://orcid.org/0000-0002-2555-9199)
- Chuan Xu
- Zhina Song
- Chuanwen Hu
- Zheyi Hu
Institutions
- Wuhan University (CN)
- Chinese Academy of Surveying and Mapping (CN)
- Hubei University of Technology (CN)
Publication Details
- Journal
- Remote Sensing
- Published
- 2026-04-15
- DOI
- https://doi.org/10.3390/rs18081178
- Primary Topic
- Advanced Image Fusion Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Hubei University of Technology
- Natural Science Foundation of Hubei Province
- Hubei University
- Division of Graduate Education