HIT-Net: A high-information-capacity dual-channel transformer network for video snapshot compressive imaging
Video snapshot compressive imaging is a computational imaging technique based on compressed sensing that acquires high-speed frames through a 2D compressed measurement, followed by an algorithmic reconstruction. Current deep learning-based reconstruction methods operate on single-channel measurements and fail to fully capture complex inter-element dependencies, resulting in detail loss and artifacts in high-precision reconstruction tasks. To address these issues, we propose a high-information-capacity dual-channel transformer network. The network first introduces a dual-channel fusion structure that increases effective input information, thereby reducing the equivalent compression ratio and improving reconstruction quality. We further enhance the transformer by replacing conventional positional encodings with a relative Gaussian weighting scheme and introducing an adaptive multi-head structure together with variable cross section residual connections, significantly strengthening the modeling of inter-element dependencies and high-fidelity detail recovery. Experiments on six standard benchmark datasets (Kobe, Runner, Aerial, Crash, Drop, and Traffic) demonstrate that the proposed method markedly outperforms all compared approaches and is the only one that consistently exceeds 30 dB peak signal-to-noise ratio across all datasets.
Authors
- J Y Chen
- Jinshou Tian (ORCID: https://orcid.org/0000-0001-9810-1093)
- Qi Li (ORCID: https://orcid.org/0000-0001-8776-8730)
- Pengwei Zhang (ORCID: https://orcid.org/0000-0002-9315-9912)
- Luxia Xu
- Liwei Xin
- Yanhua Xue
- Chao Ji (ORCID: https://orcid.org/0009-0004-1883-2945)
- Wei Zhao (ORCID: https://orcid.org/0000-0002-4367-4668)
- Duan Luo
Institutions
- PLA Rocket Force University of Engineering (CN)
- Xi'an Institute of Optics and Precision Mechanics (CN)
- Shaanxi University of Science and Technology (CN)
Publication Details
- Journal
- AIP Advances
- Published
- 2026-05-01
- DOI
- https://doi.org/10.1063/5.0316603
- Primary Topic
- Sparse and Compressive Sensing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- National Key Scientific Instrument and Equipment Development Projects of China