Mask-guided Multi-scale Spatial-Spectral Transformer for Snapshot Compressive Imaging
Effectively reconstructing 3D hyperspectral images (HSIs) from 2D measurements presents a significant challenge in Coded Aperture Snapshot Spectral Imaging (CASSI) systems. While recent transformers exhibit potential in HSI reconstruction, they often suffer from inadequate exploration of multi-scale spatial-spectral self-similarity, leading to mean effects and information loss. Additionally, these methods struggle with insufficient modeling of the degradation inherent in the compressive imaging process. To address these issues, we propose a novel Mask-guided Multi-scale Spatial-Spectral Transformer (MMSST). Specifically, we introduce a Degradation Aware Mask Attention (DAMA) module to incorporate degradation information of the compressive imaging process. Furthermore, MMSST leverages Local-Regional SpAtial attention (LRSA) and Global-Regional SpEctral attention (GRSE) to effectively exploit multi-scale self-similarity across spatial and spectral dimensions. Extensive experimental results demonstrate the effectiveness of our MMSST.
Authors
- Jingxiang Yang (ORCID: https://orcid.org/0000-0002-1234-0614)
- Haiyan Yin (ORCID: https://orcid.org/0009-0007-9576-9398)
- Jia Liu (ORCID: https://orcid.org/0000-0002-5999-2361)
- Xiao Liang (ORCID: https://orcid.org/0009-0007-6881-4210)
Institutions
- Nanjing University of Science and Technology (CN)
Publication Details
- Published
- 2025-03-12
- DOI
- https://doi.org/10.1109/icassp49660.2025.10888679
- Citations
- 1
- Primary Topic
- Optical Imaging and Spectroscopy Techniques
- Type
- article
- Field-Weighted Citation Impact
- 1.36
Funders
- National Natural Science Foundation of China