Neural light field representation and reconstruction based on a ray displacement field

High-quality light field (LF) acquisition involves a trade-off between spatial and angular resolution. Hybrid camera systems offer a practical solution but present challenges for dense reconstruction due to sparse angular sampling and complex occlusions. To address these issues, this paper proposes a geometry-aware implicit neural representation (INR) framework for LF reconstruction. Distinct from traditional discrete representations or generic ray-space embeddings, we introduce a compact, continuous representation that combines a radiance field with a geometry module, where scalar disparity provides an ideal geometric interpretation and a ray-displacement field serves as the practical realization for occlusion-aware reconstruction. This framework leverages the global epipolar geometry of the 2D LF grid while utilizing the displacement field to correct local geometric inconsistencies caused by occlusions and non-Lambertian effects. By coupling these fields with a radiance network, our method enables end-to-end differentiable optimization from sparse, multi-resolution inputs without relying on large-scale external training datasets. Experiments on hybrid camera data fusion and spatial-angular super-resolution tasks demonstrate that our approach preserves high-frequency details and geometric consistency.

Authors

Institutions

Publication Details

Journal
Optics Express
Published
2026-04-07
DOI
https://doi.org/10.1364/oe.583881
Primary Topic
Visual perception and processing mechanisms
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Neural light field representation and reconstruction based on a ray displacement field

Kaiwen Yu, Chang Liu, Ligen Shi, Jun Qiu et al.
Optics Express
Visual perception and processing mechanisms
article

Neural light field representation and reconstruction based on a ray displacement field

Kaiwen Yu, Chang Liu, Ligen Shi, Jun Qiu, Lina Wu
article en

Abstract

High-quality light field (LF) acquisition involves a trade-off between spatial and angular resolution. Hybrid camera systems offer a practical solution but present challenges for dense reconstruction due to sparse angular sampling and complex occlusions. To address these issues, this paper proposes a geometry-aware implicit neural representation (INR) framework for LF reconstruction. Distinct from traditional discrete representations or generic ray-space embeddings, we introduce a compact, continuous representation that combines a radiance field with a geometry module, where scalar disparity provides an ideal geometric interpretation and a ray-displacement field serves as the practical realization for occlusion-aware reconstruction. This framework leverages the global epipolar geometry of the 2D LF grid while utilizing the displacement field to correct local geometric inconsistencies caused by occlusions and non-Lambertian effects. By coupling these fields with a radiance network, our method enables end-to-end differentiable optimization from sparse, multi-resolution inputs without relying on large-scale external training datasets. Experiments on hybrid camera data fusion and spatial-angular super-resolution tasks demonstrate that our approach preserves high-frequency details and geometric consistency.

Optics ExpressVol. 34(8)
Inner Mongolia University (CN), Beijing Information Science & Technology University (CN)
National Natural Science Foundation of China
Openalex Percentile: Top 29%
Visual perception and processing mechanisms
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.