Mesh-represented and learning-empowered hologram synthesis for full 3D holographic displays

Holographic displays are a transforming technology for immersive virtual and augmented reality systems. Exploring accurate yet efficient computer-generated holography (CGH) algorithms for three-dimensional (3D) content is a valuable research field. Recent advancements in layer-based CGH may exhibit limited capacity to convey comprehensive 3D information in accurately representing tilted angular spectrum and realizing realistic defocus blur. Alternative approaches based on point clouds and light fields may demand significant computational resources for preparing adequate target data for optimization. In addition, most existing CGH algorithms rely on heuristics to encode complex amplitudes into phase-only holograms for display, which can be highly ill-posed. Here we investigate an innovative CGH framework that overcomes these challenges using a unique combination of mesh-based representation, tilt-angle tailored wave propagation modeling, and complex-valued optimization, alongside a learning-empowered display calibration scheme using camera feedback. The resulting expanded hologram encoding capabilities enable the delivery of natural 3D depth cues, including smooth defocus blur and view-dependent effects. Experimental results conducted on our holographic near-eye display prototype demonstrate unprecedented full 3D visual quality, representing a significant advancement in creating immersive visualization experiences. The authors describe a method for rendering mesh scenes into complex-valued wave fields, before computing phase-only holograms using complex-valued supervision instead of amplitude-only objectives. This enables full-3D holography with smooth defocus blur, continuous depth perception. and view-dependent effects.