Intelligent Attention-Based QoE Enhancement for VR Interaction: Keyframe Extraction and Resource Allocation
The rapid expansion of multi-user virtual reality (VR) applications, such as VR gaming and the Metaverse, has heightened the demand for bandwidth-efficient, immersive experiences. This paper introduces a customized Quality of Experience (QoE) framework tailored to VR interactions in a sub-6 GHz communication environment, integrating attention-based interaction, keyframe extraction, and principles from the Weber-Fechner Law. The QoE maximization problem is formulated as a Mixed Integer Programming (MIP) problem that jointly optimizes keyframe extraction ratio and resource allocation (i.e., bandwidth and CPU frequency), incorporating fairness. We employ the Deep Deterministic Policy Gradient (DDPG) algorithm as a reinforcement learning strategy. Evaluation with the Motion Capture Database demonstrates that our framework significantly reduces interactive latency, enhances QoE, and maintains fairness, achieving superior performance compared to baseline methods.
Authors
- Danny H. K. Tsang (ORCID: https://orcid.org/0000-0003-0135-7098)
- Jiadong Yu (ORCID: https://orcid.org/0000-0003-4773-5402)
- Zhenhai Zhang (ORCID: https://orcid.org/0000-0003-0378-1693)
Institutions
- Hong Kong University of Science and Technology (HK)
Publication Details
- Published
- 2025-06-08
- DOI
- https://doi.org/10.1109/icc52391.2025.11161962
- Primary Topic
- Image and Video Quality Assessment
- Type
- article
- Field-Weighted Citation Impact
- 0.00