Real-time 3D object generation by MEMS phase light modulator based on camera input for advanced driver assistance system applications

A micro-electromechanical system phase light modulator and accelerated computer-generated hologram calculations enable real-time rendering of point- and line-based 3D objects based on camera inputs. We developed a real-time pipeline in a holographic 3D display [(heads-up display (HUD)] for advanced driver assistance systems (ADAS) by employing the Texas Instruments phase light modulator (TI-PLM). Three key challenges were addressed in this paper: road lane recognition via OpenCV, latency-free CGH calculation and display on TI-PLM using graphics processing unit (GPU) in compute unified device architecture (CUDA) mode, and precise optical overlay of 3D images onto the road lanes through a first-order optical model. This ensures the 3D image is displayed at the correct size and depth, guiding drivers with real-time navigation data. Our GPU-based approach achieves real-time, accurate 3D image rendering, demonstrating the potential of holographic HUDs for safer, more intuitive automotive navigation.