HoloJig: Interactive Spoken Prompt Specified Generative AI Environments
HoloJig offers an interactive, speech-to-virtual reality (VR), VR experience that generates diverse environments in real time based on live spoken descriptions. Unlike traditional VR systems that rely on prebuilt assets, HoloJig dynamically creates personalized and immersive virtual spaces with depth-based parallax 3-D rendering, allowing users to define the characteristics of their immersive environment through verbal prompts. This generative approach opens up new possibilities for interactive experiences, including simulations, training, collaborative workspaces, and entertainment. In addition to speech-to-VR environment generation, a key innovation of HoloJig is its progressive visual transition mechanism, which smoothly dissolves between previously generated and newly requested environments, mitigating the delay caused by neural computations. This feature ensures a seamless and continuous user experience, even as new scenes are being rendered on remote servers.
Authors
- Kenny Mitchell (ORCID: https://orcid.org/0000-0003-2420-7447)
- Samantha Hannah
- Llogari Casas (ORCID: https://orcid.org/0000-0003-0643-9762)
Institutions
- Edinburgh Napier University (GB)
Publication Details
- Journal
- IEEE Computer Graphics and Applications
- Published
- 2025-03-01
- DOI
- https://doi.org/10.1109/mcg.2025.3553780
- Primary Topic
- Speech and dialogue systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00