Scene Graph Driven Hybrid Interactive VR Teleconferencing
We propose an interactive and intelligent hybrid teleconferencing system compatible with Virtual Reality devices. Our system understands meeting contexts and leverages user interactions to enhance better system configuration. Employing interactive scene graphs [11], the system extracts and transmits essential meeting context to users while relaying user interactions back to the streaming systems for user-involved adaptive streaming and foveated rendering. We demonstrate the system's real-time performance and compatibility with commercial VR devices such as the Meta Quest 3.
Authors
- Beitong Tian (ORCID: https://orcid.org/0000-0002-8969-914X)
- Jiaxi Li (ORCID: https://orcid.org/0009-0004-3678-2240)
- Ramesh K. Sitaraman (ORCID: https://orcid.org/0000-0003-0558-6875)
- Klara Nahrstedt (ORCID: https://orcid.org/0000-0001-6813-3043)
- Jacob Chakareski (ORCID: https://orcid.org/0000-0003-2428-9518)
- Rui-Xiao Zhang (ORCID: https://orcid.org/0000-0002-4251-825X)
- Michael Zink (ORCID: https://orcid.org/0000-0002-0309-9240)
- Haozhen Zheng
- Ruifan Ji
- Mingyuan Wu (ORCID: https://orcid.org/0009-0009-6489-0747)
- Bo Chen (ORCID: https://orcid.org/0009-0006-3392-4834)
Institutions
- New Jersey Institute of Technology (US)
- University of Illinois Urbana-Champaign (US)
Publication Details
- Published
- 2024-10-26
- DOI
- https://doi.org/10.1145/3664647.3684996
- Citations
- 2
- Primary Topic
- Virtual Reality Applications and Impacts
- Type
- article
- Field-Weighted Citation Impact
- 0.74