HIT-Net: A high-information-capacity dual-channel transformer network for video snapshot compressive imaging

Video snapshot compressive imaging is a computational imaging technique based on compressed sensing that acquires high-speed frames through a 2D compressed measurement, followed by an algorithmic reconstruction. Current deep learning-based reconstruction methods operate on single-channel measurements and fail to fully capture complex inter-element dependencies, resulting in detail loss and artifacts in high-precision reconstruction tasks. To address these issues, we propose a high-information-capacity dual-channel transformer network. The network first introduces a dual-channel fusion structure that increases effective input information, thereby reducing the equivalent compression ratio and improving reconstruction quality. We further enhance the transformer by replacing conventional positional encodings with a relative Gaussian weighting scheme and introducing an adaptive multi-head structure together with variable cross section residual connections, significantly strengthening the modeling of inter-element dependencies and high-fidelity detail recovery. Experiments on six standard benchmark datasets (Kobe, Runner, Aerial, Crash, Drop, and Traffic) demonstrate that the proposed method markedly outperforms all compared approaches and is the only one that consistently exceeds 30 dB peak signal-to-noise ratio across all datasets.

Authors

Institutions

Publication Details

Journal
AIP Advances
Published
2026-05-01
DOI
https://doi.org/10.1063/5.0316603
Primary Topic
Sparse and Compressive Sensing Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

HIT-Net: A high-information-capacity dual-channel transformer network for video snapshot compressive imaging

J Y Chen, Jinshou Tian, Qi Li, Pengwei Zhang et al.
AIP Advances
Sparse and Compressive Sensing Techniques
article

HIT-Net: A high-information-capacity dual-channel transformer network for video snapshot compressive imaging

J Y Chen, Jinshou Tian, Qi Li, Pengwei Zhang, Luxia Xu, Liwei Xin, Yanhua Xue, Chao Ji, Wei Zhao, Duan Luo
article en

Abstract

Video snapshot compressive imaging is a computational imaging technique based on compressed sensing that acquires high-speed frames through a 2D compressed measurement, followed by an algorithmic reconstruction. Current deep learning-based reconstruction methods operate on single-channel measurements and fail to fully capture complex inter-element dependencies, resulting in detail loss and artifacts in high-precision reconstruction tasks. To address these issues, we propose a high-information-capacity dual-channel transformer network. The network first introduces a dual-channel fusion structure that increases effective input information, thereby reducing the equivalent compression ratio and improving reconstruction quality. We further enhance the transformer by replacing conventional positional encodings with a relative Gaussian weighting scheme and introducing an adaptive multi-head structure together with variable cross section residual connections, significantly strengthening the modeling of inter-element dependencies and high-fidelity detail recovery. Experiments on six standard benchmark datasets (Kobe, Runner, Aerial, Crash, Drop, and Traffic) demonstrate that the proposed method markedly outperforms all compared approaches and is the only one that consistently exceeds 30 dB peak signal-to-noise ratio across all datasets.

AIP AdvancesVol. 16(5)
PLA Rocket Force University of Engineering (CN), Xi'an Institute of Optics and Precision Mechanics (CN), Shaanxi University of Science and Technology (CN)
National Natural Science Foundation of China, National Key Scientific Instrument and Equipment Development Projects of China
Openalex Percentile: Top 8%
Sparse and Compressive Sensing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.