Physics-informed neural network enables high-frame-rate single-lens computational imaging
A single-lens computational imaging system combines a single lens with post-processing algorithms to achieve a lightweight design while maintaining imaging quality.However, the computational inefficiency of existing reconstruction methods often limits the achievable frame rate on edge devices, falling short of the practical requirement of 30-60 frames per second (fps).Here, we adopt a physics-informed neural network that integrates an improved Wiener deconvolution (IWD) with a compact Res-Unet variant.The simple yet effective Wiener deconvolution step reduces image blur and spatially variant degradation, thereby alleviating the workload of the subsequent network and enabling high-quality, real-time reconstruction.Simulation and experimental results demonstrate that this framework can further reduce the algorithmic complexity for a single-lens system, achieving real-time reconstruction at 40 fps for 640 480 resolution on an RK3588 system-on-chip (SoC), while maintaining a system modulation transfer function (MTF) above 0.39 at Nyquist frequency (42 lp/mm).
Authors
- Zhanshan Wang (ORCID: https://orcid.org/0000-0002-6022-4933)
- Dongfang Yang (ORCID: https://orcid.org/0000-0003-3804-9726)
- Yujie Xing
- Xuquan Wang (ORCID: https://orcid.org/0009-0002-5962-7193)
- Xinbin Cheng (ORCID: https://orcid.org/0000-0002-3855-483X)
- Jian Zhang (ORCID: https://orcid.org/0000-0003-2908-1935)
- Xiong Dun
- Xuanyu Qian
Institutions
- Tongji University (CN)
Publication Details
- Journal
- Chinese Optics Letters
- Published
- 2025-01-01
- DOI
- https://doi.org/10.3788/col202523.121101
- Primary Topic
- Neural Networks and Reservoir Computing
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities