Denoiser Learning for Infrared and Visible Image Fusion

Infrared image (IR) and visible image (VI) fusion creates fusion images that contain richer information and gain improved visual effects. Existing methods generally use the operators of manual design, such as intensity and gradient operators, to mine the image information. However, it is hard for them to achieve a complete and accurate description of information, which limits the image fusion performance. To this end, a novel information measurement method is proposed to achieve IR and VI fusion. Its core idea is to guide a generator in achieving image fusion by learning the denoisers. Specifically, by using denoisers to restore fusion images with different noise interference to source images, a mutual competition relationship is formed between denoisers, which helps the generator thoroughly explore the data specificity of the source images and guide it to achieve more accurate feature representation. In addition, a semantic adaptive measurement loss function is proposed to constrain the generator, which fuses semantic information adaptively by considering the semantic information density of different source images. The results of quantitative and qualitative experiments have shown that the proposed method can achieve a higher quality information fusion and has a faster fusion speed on three public datasets when compared with advanced methods.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Neural Networks and Learning Systems
Published
2024-10-10
DOI
https://doi.org/10.1109/tnnls.2024.3454811
Citations
5
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
1.60

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Denoiser Learning for Infrared and Visible Image Fusion

Renwei Dian, Jinyang Liu, Shutao Li, L.B. Tan
5 citations
IEEE Transactions on Neural Networks and Learning Systems
Advanced Image Fusion Techniques
1.60
article

Denoiser Learning for Infrared and Visible Image Fusion

Renwei Dian, Jinyang Liu, Shutao Li, L.B. Tan
article en
5 citations

Abstract

Infrared image (IR) and visible image (VI) fusion creates fusion images that contain richer information and gain improved visual effects. Existing methods generally use the operators of manual design, such as intensity and gradient operators, to mine the image information. However, it is hard for them to achieve a complete and accurate description of information, which limits the image fusion performance. To this end, a novel information measurement method is proposed to achieve IR and VI fusion. Its core idea is to guide a generator in achieving image fusion by learning the denoisers. Specifically, by using denoisers to restore fusion images with different noise interference to source images, a mutual competition relationship is formed between denoisers, which helps the generator thoroughly explore the data specificity of the source images and guide it to achieve more accurate feature representation. In addition, a semantic adaptive measurement loss function is proposed to constrain the generator, which fuses semantic information adaptively by considering the semantic information density of different source images. The results of quantitative and qualitative experiments have shown that the proposed method can achieve a higher quality information fusion and has a faster fusion speed on three public datasets when compared with advanced methods.

IEEE Transactions on Neural Networks and Learning SystemsVol. 36(7)
Hunan University (CN)
National Natural Science Foundation of China, National Key Research and Development Program of China
Openalex Percentile: Top 14%
Advanced Image Fusion Techniques
1.60
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Denoiser Learning for Infrared and Visible Image Fusion — Renwei Dian, Jinyang Liu, et al. · IEEE Transactions on Neural Networks and Learning Systems (2024) | TGRS Research Map | TGRS