Neural light field representation and reconstruction based on a ray displacement field
High-quality light field (LF) acquisition involves a trade-off between spatial and angular resolution. Hybrid camera systems offer a practical solution but present challenges for dense reconstruction due to sparse angular sampling and complex occlusions. To address these issues, this paper proposes a geometry-aware implicit neural representation (INR) framework for LF reconstruction. Distinct from traditional discrete representations or generic ray-space embeddings, we introduce a compact, continuous representation that combines a radiance field with a geometry module, where scalar disparity provides an ideal geometric interpretation and a ray-displacement field serves as the practical realization for occlusion-aware reconstruction. This framework leverages the global epipolar geometry of the 2D LF grid while utilizing the displacement field to correct local geometric inconsistencies caused by occlusions and non-Lambertian effects. By coupling these fields with a radiance network, our method enables end-to-end differentiable optimization from sparse, multi-resolution inputs without relying on large-scale external training datasets. Experiments on hybrid camera data fusion and spatial-angular super-resolution tasks demonstrate that our approach preserves high-frequency details and geometric consistency.
Authors
- Kaiwen Yu (ORCID: https://orcid.org/0000-0003-0118-3593)
- Chang Liu
- Ligen Shi
- Jun Qiu
- Lina Wu
Institutions
- Inner Mongolia University (CN)
- Beijing Information Science & Technology University (CN)
Publication Details
- Journal
- Optics Express
- Published
- 2026-04-07
- DOI
- https://doi.org/10.1364/oe.583881
- Primary Topic
- Visual perception and processing mechanisms
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China