Digital media art design system based on virtual reality and optical tracking technology

Due to technical limitations, the existing digital art design systems exhibit a single interaction mode and insufficient immersion, failing to meet users' needs for efficient creation and highly immersive experiences. To address these challenges within the framework of Extended Reality (XR), this paper constructs a digital media art design system based on virtual reality (VR) technology. By leveraging real-time generation and dynamic rendering of three-dimensional virtual environments, the system delivers high-fidelity design scenes. Through the integration of gesture recognition and eye tracking, it supports intuitive human-computer interaction, while multimodal technologies—such as dynamic sound effects, tactile feedback, and refined lighting control—enhance the multisensory experience. In addition, in order to further enhance the visual rendering authenticity of the system and improve the accuracy of interaction with users, the system integrates high-precision optical tracking and light field imaging technology, so that users can experience a more immersive design environment. Experimental results show that the system achieves a rendering speed exceeding 60 frames per second and maintains interaction latency within 20 milliseconds. Positioned under the broader umbrella of XR applications, this study demonstrates that VR-based design environments significantly optimize both system performance and user experience, offering valuable insights for the future development of digital art creation technologies.

Authors

Institutions

Publication Details

Published
2025-06-18
DOI
https://doi.org/10.1117/12.3073494
Primary Topic
Digital Media and Visual Art
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Digital media art design system based on virtual reality and optical tracking technology

Liming Zheng, Wuzhi Zhang, Ying Choon Wu
Digital Media and Visual Art
article

Digital media art design system based on virtual reality and optical tracking technology

Liming Zheng, Wuzhi Zhang, Ying Choon Wu
article en

Abstract

Due to technical limitations, the existing digital art design systems exhibit a single interaction mode and insufficient immersion, failing to meet users' needs for efficient creation and highly immersive experiences. To address these challenges within the framework of Extended Reality (XR), this paper constructs a digital media art design system based on virtual reality (VR) technology. By leveraging real-time generation and dynamic rendering of three-dimensional virtual environments, the system delivers high-fidelity design scenes. Through the integration of gesture recognition and eye tracking, it supports intuitive human-computer interaction, while multimodal technologies—such as dynamic sound effects, tactile feedback, and refined lighting control—enhance the multisensory experience. In addition, in order to further enhance the visual rendering authenticity of the system and improve the accuracy of interaction with users, the system integrates high-precision optical tracking and light field imaging technology, so that users can experience a more immersive design environment. Experimental results show that the system achieves a rendering speed exceeding 60 frames per second and maintains interaction latency within 20 milliseconds. Positioned under the broader umbrella of XR applications, this study demonstrates that VR-based design environments significantly optimize both system performance and user experience, offering valuable insights for the future development of digital art creation technologies.

Guangdong Polytechnic of Science and Technology (CN), Guangzhou Vocational College of Science and Technology (CN)
Sustainable cities and communities
Openalex Percentile: Top 75%
Digital Media and Visual Art
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.