DIFTransNet: Dual-Branch Interactive Fusion Network With CNN and Multiscale Transformer for Infrared Small Target Detection
Recent advances in hybrid architectures combining convolutional neural networks (CNNs) and Transformers have demonstrated significant potential in infrared small target detection. However, existing methods suffer from limited interaction depth, leading to weak cross-layer feature coordination. To address this, we propose the DIFTransNet, a dual-branch interactive fusion network that implements hierarchical mutual refinement between CNN and Transformer pathways. Specifically, the DIFTransNet incorporates an interactive fusion module (IFM) at each hybrid encoding stage that bridges local details and global semantics through shared latent space projection and cross-attention mechanisms, enabling aligned deep fusion. In the Transformer branch, we introduce the hierarchical decoupled sparse attention (HDSA) with resolution-progressive window partitioning, which preserves dim targets through dense local sampling while suppressing noise via cross-region sparse correlations. Moreover, rethinking the information gap in conventional skip connections between shallow and deep layers, we propose a reorganized skip augmentation module (RSAM). It introduces a cross-level bidirectional fusion strategy, where the closed-loop architecture enables dual compensation between spatial details and semantic contexts. The experimental results on the NUDT-SIRST, SIRST, and IRSTD-1K datasets demonstrate that the proposed DIFTransNet surpasses current state-of-the-art methods in accurate detection of infrared small targets.
Authors
- Changbin Xue (ORCID: https://orcid.org/0000-0003-1834-7849)
- Bobo Xi (ORCID: https://orcid.org/0000-0002-0309-1556)
- Shenao Liu
- Tie Zheng
- Jiaojiao Li (ORCID: https://orcid.org/0000-0002-0470-9469)
- Haitao Xu (ORCID: https://orcid.org/0009-0004-0143-4246)
- Yunsong Li (ORCID: https://orcid.org/0000-0002-0234-6270)
Institutions
- Xidian University (CN)
- Chinese Academy of Sciences (CN)
- National Space Science Center (CN)
Publication Details
- Journal
- IEEE Transactions on Geoscience and Remote Sensing
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tgrs.2025.3605399
- Citations
- 1
- Primary Topic
- Infrared Target Detection Methodologies
- Type
- article
- Field-Weighted Citation Impact
- 4.99
Funders
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Natural Science Foundation of Shaanxi Province
- Basic and Applied Basic Research Foundation of Guangdong Province