DFSMamba: Detail-Guided and Direction-Adaptive State-Space Modeling for Structure-Preserving Visible-to-Infrared Image Translation

Infrared imagery supports low-light target perception, but acquiring, registering, and annotating paired visible–infrared imagery is costly. Visible-to-infrared image translation can alleviate this demand, yet cross-modal differences often degrade object boundaries and spatial layouts, especially for small targets. We propose DFSMamba to preserve geometric structure throughout visible-to-infrared translation by connecting frequency-guided feature formation, input-dependent directional aggregation, and infrared-domain reconstruction supervision. A discrete wavelet transform (DWT)-based detail-guided module supplements bottleneck features with learned structural cues, direction-adaptive 2D selective scan adjusts the fusion of aligned directional responses, and state-space similarity matching constrains the output in a fixed multiscale feature space learned through real-infrared reconstruction. Experiments on FMB, VEDAI, and AVIID-1 include image-quality comparisons, target-level evaluation, ablation studies, efficiency analysis, and downstream vehicle detection. Among evaluated methods, DFSMamba achieves the best SSIM, MS-SSIM, PSNR, and L1 values on all three datasets. On AVIID-1, it obtains an SSIM of 0.985 and a PSNR of 41.799 dB. A YOLOv9-C detector trained on generated images reaches an AP50:95 of 0.636 on real infrared test images, compared with 0.640 when trained on real infrared images. These results show that DFSMamba preserves detection-relevant structure and supports the use of generated images as synthetic training data in the evaluated aerial vehicle-detection setting.

Authors

Institutions

Publication Details

Journal
Remote Sensing
Published
2026-10-28
DOI
https://doi.org/10.3390/rs18213715
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

DFSMamba: Detail-Guided and Direction-Adaptive State-Space Modeling for Structure-Preserving Visible-to-Infrared Image Translation

Canbin Hu, Fei Ma, Shuang Li, Xiaokun Sun
5 links
Remote Sensing
Advanced Image Fusion Techniques
article

DFSMamba: Detail-Guided and Direction-Adaptive State-Space Modeling for Structure-Preserving Visible-to-Infrared Image Translation

Canbin Hu, Fei Ma, Shuang Li, Xiaokun Sun
article en

Abstract

Infrared imagery supports low-light target perception, but acquiring, registering, and annotating paired visible–infrared imagery is costly. Visible-to-infrared image translation can alleviate this demand, yet cross-modal differences often degrade object boundaries and spatial layouts, especially for small targets. We propose DFSMamba to preserve geometric structure throughout visible-to-infrared translation by connecting frequency-guided feature formation, input-dependent directional aggregation, and infrared-domain reconstruction supervision. A discrete wavelet transform (DWT)-based detail-guided module supplements bottleneck features with learned structural cues, direction-adaptive 2D selective scan adjusts the fusion of aligned directional responses, and state-space similarity matching constrains the output in a fixed multiscale feature space learned through real-infrared reconstruction. Experiments on FMB, VEDAI, and AVIID-1 include image-quality comparisons, target-level evaluation, ablation studies, efficiency analysis, and downstream vehicle detection. Among evaluated methods, DFSMamba achieves the best SSIM, MS-SSIM, PSNR, and L1 values on all three datasets. On AVIID-1, it obtains an SSIM of 0.985 and a PSNR of 41.799 dB. A YOLOv9-C detector trained on generated images reaches an AP50:95 of 0.636 on real infrared test images, compared with 0.640 when trained on real infrared images. These results show that DFSMamba preserves detection-relevant structure and supports the use of generated images as synthetic training data in the evaluated aerial vehicle-detection setting.

Remote SensingVol. 18(21)
Beijing University of Chemical Technology (CN)
Fundamental Research Funds for the Central Universities
Openalex Percentile: Top 14%
Advanced Image Fusion Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon