Physics-informed neural network enables high-frame-rate single-lens computational imaging

A single-lens computational imaging system combines a single lens with post-processing algorithms to achieve a lightweight design while maintaining imaging quality.However, the computational inefficiency of existing reconstruction methods often limits the achievable frame rate on edge devices, falling short of the practical requirement of 30-60 frames per second (fps).Here, we adopt a physics-informed neural network that integrates an improved Wiener deconvolution (IWD) with a compact Res-Unet variant.The simple yet effective Wiener deconvolution step reduces image blur and spatially variant degradation, thereby alleviating the workload of the subsequent network and enabling high-quality, real-time reconstruction.Simulation and experimental results demonstrate that this framework can further reduce the algorithmic complexity for a single-lens system, achieving real-time reconstruction at 40 fps for 640 480 resolution on an RK3588 system-on-chip (SoC), while maintaining a system modulation transfer function (MTF) above 0.39 at Nyquist frequency (42 lp/mm).

Authors

Institutions

Publication Details

Journal
Chinese Optics Letters
Published
2025-01-01
DOI
https://doi.org/10.3788/col202523.121101
Primary Topic
Neural Networks and Reservoir Computing
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Physics-informed neural network enables high-frame-rate single-lens computational imaging

Zhanshan Wang, Dongfang Yang, Yujie Xing, Xuquan Wang et al.
Chinese Optics Letters
Neural Networks and Reservoir Computing
article

Physics-informed neural network enables high-frame-rate single-lens computational imaging

Zhanshan Wang, Dongfang Yang, Yujie Xing, Xuquan Wang, Xinbin Cheng, Jian Zhang, Xiong Dun, Xuanyu Qian
article en

Abstract

A single-lens computational imaging system combines a single lens with post-processing algorithms to achieve a lightweight design while maintaining imaging quality.However, the computational inefficiency of existing reconstruction methods often limits the achievable frame rate on edge devices, falling short of the practical requirement of 30-60 frames per second (fps).Here, we adopt a physics-informed neural network that integrates an improved Wiener deconvolution (IWD) with a compact Res-Unet variant.The simple yet effective Wiener deconvolution step reduces image blur and spatially variant degradation, thereby alleviating the workload of the subsequent network and enabling high-quality, real-time reconstruction.Simulation and experimental results demonstrate that this framework can further reduce the algorithmic complexity for a single-lens system, achieving real-time reconstruction at 40 fps for 640 480 resolution on an RK3588 system-on-chip (SoC), while maintaining a system modulation transfer function (MTF) above 0.39 at Nyquist frequency (42 lp/mm).

Chinese Optics LettersVol. 23(12)
Tongji University (CN)
National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities
Openalex Percentile: Top 83%
Neural Networks and Reservoir Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.