Model Pruning for Infrared-Visible Image Fusion
Infrared-visible image fusion combines complementary information from both modalities, enhancing scene perception in applications such as surveillance and autonomous driving. However, existing deep learning-based methods are often computationally expensive. Our approach involves training an over-parameterized fusion network, applying structured pruning to reduce model complexity, and fine-tuning the pruned model to maintain performance. The pruning process leverages the L2-norm of the Restormer blocks, ensuring that less critical components are removed while preserving essential fusion quality. Experiments on the benchmark datasets demonstrate that our approach achieves high fusion quality with significantly reduced computational costs. Ablation studies further validate the effectiveness of our pruning strategy.
Authors
- Qi Chen (ORCID: https://orcid.org/0000-0002-0279-8883)
- Rui Feng (ORCID: https://orcid.org/0000-0002-0611-9518)
Institutions
- State Grid Corporation of China (China) (CN)
Publication Details
- Published
- 2024-09-13
- DOI
- https://doi.org/10.1109/mvipit65697.2024.00038
- Primary Topic
- Advanced Image Fusion Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00