Model Pruning for Infrared-Visible Image Fusion

Infrared-visible image fusion combines complementary information from both modalities, enhancing scene perception in applications such as surveillance and autonomous driving. However, existing deep learning-based methods are often computationally expensive. Our approach involves training an over-parameterized fusion network, applying structured pruning to reduce model complexity, and fine-tuning the pruned model to maintain performance. The pruning process leverages the L2-norm of the Restormer blocks, ensuring that less critical components are removed while preserving essential fusion quality. Experiments on the benchmark datasets demonstrate that our approach achieves high fusion quality with significantly reduced computational costs. Ablation studies further validate the effectiveness of our pruning strategy.

Authors

Institutions

Publication Details

Published
2024-09-13
DOI
https://doi.org/10.1109/mvipit65697.2024.00038
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Model Pruning for Infrared-Visible Image Fusion

Qi Chen, Rui Feng
Advanced Image Fusion Techniques
article

Model Pruning for Infrared-Visible Image Fusion

Qi Chen, Rui Feng
article en

Abstract

Infrared-visible image fusion combines complementary information from both modalities, enhancing scene perception in applications such as surveillance and autonomous driving. However, existing deep learning-based methods are often computationally expensive. Our approach involves training an over-parameterized fusion network, applying structured pruning to reduce model complexity, and fine-tuning the pruned model to maintain performance. The pruning process leverages the L2-norm of the Restormer blocks, ensuring that less critical components are removed while preserving essential fusion quality. Experiments on the benchmark datasets demonstrate that our approach achieves high fusion quality with significantly reduced computational costs. Ablation studies further validate the effectiveness of our pruning strategy.

State Grid Corporation of China (China) (CN)
Openalex Percentile: Top 59%
Advanced Image Fusion Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.