A Modular and Robust Physics-Based Approach for Lensless Image Reconstruction

In this paper, we present a modular approach for reconstructing lensless measurements. It consists of three components: a newly-proposed pre-processor, a physics-based camera inverter to undo the multiplexing of lensless imaging, and a post-processor. The pre-and post-processors address noise and artifacts unique to lensless imaging before and after camera inversion respectively. By training the three components end-to-end, we obtain a 1.9 dB increase in PSNR and a $14 \%$ relative improvement in a perceptual image metric (LPIPS) with respect to previously proposed physics-based methods. We also demonstrate how the proposed pre-processor provides more robustness to input noise, and how an auxiliary loss can improve interpretability.

Authors

Institutions

Publication Details

Published
2024-09-27
DOI
https://doi.org/10.1109/icip51287.2024.10647433
Citations
2
Primary Topic
Image Processing Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.64

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Modular and Robust Physics-Based Approach for Lensless Image Reconstruction

Eric Bezzam, Martin Vetterli, Yohann Perron
2 citations
Image Processing Techniques and Applications
0.64
article

A Modular and Robust Physics-Based Approach for Lensless Image Reconstruction

Eric Bezzam, Martin Vetterli, Yohann Perron
article en
2 citations

Abstract

In this paper, we present a modular approach for reconstructing lensless measurements. It consists of three components: a newly-proposed pre-processor, a physics-based camera inverter to undo the multiplexing of lensless imaging, and a post-processor. The pre-and post-processors address noise and artifacts unique to lensless imaging before and after camera inversion respectively. By training the three components end-to-end, we obtain a 1.9 dB increase in PSNR and a $14 \%$ relative improvement in a perceptual image metric (LPIPS) with respect to previously proposed physics-based methods. We also demonstrate how the proposed pre-processor provides more robustness to input noise, and how an auxiliary loss can improve interpretability.

École Polytechnique Fédérale de Lausanne (CH)
National Science Foundation
Sustainable cities and communities
Openalex Percentile: Top 26%
Image Processing Techniques and Applications
0.64
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Modular and Robust Physics-Based Approach for Lensless Image Reconstruction — Eric Bezzam, Martin Vetterli, et al. · (2024) | TGRS Research Map | TGRS