Intelligent Attention-Based QoE Enhancement for VR Interaction: Keyframe Extraction and Resource Allocation

The rapid expansion of multi-user virtual reality (VR) applications, such as VR gaming and the Metaverse, has heightened the demand for bandwidth-efficient, immersive experiences. This paper introduces a customized Quality of Experience (QoE) framework tailored to VR interactions in a sub-6 GHz communication environment, integrating attention-based interaction, keyframe extraction, and principles from the Weber-Fechner Law. The QoE maximization problem is formulated as a Mixed Integer Programming (MIP) problem that jointly optimizes keyframe extraction ratio and resource allocation (i.e., bandwidth and CPU frequency), incorporating fairness. We employ the Deep Deterministic Policy Gradient (DDPG) algorithm as a reinforcement learning strategy. Evaluation with the Motion Capture Database demonstrates that our framework significantly reduces interactive latency, enhances QoE, and maintains fairness, achieving superior performance compared to baseline methods.

Authors

Institutions

Publication Details

Published
2025-06-08
DOI
https://doi.org/10.1109/icc52391.2025.11161962
Primary Topic
Image and Video Quality Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Intelligent Attention-Based QoE Enhancement for VR Interaction: Keyframe Extraction and Resource Allocation

Danny H. K. Tsang, Jiadong Yu, Zhenhai Zhang
Image and Video Quality Assessment
article

Intelligent Attention-Based QoE Enhancement for VR Interaction: Keyframe Extraction and Resource Allocation

Danny H. K. Tsang, Jiadong Yu, Zhenhai Zhang
article en

Abstract

The rapid expansion of multi-user virtual reality (VR) applications, such as VR gaming and the Metaverse, has heightened the demand for bandwidth-efficient, immersive experiences. This paper introduces a customized Quality of Experience (QoE) framework tailored to VR interactions in a sub-6 GHz communication environment, integrating attention-based interaction, keyframe extraction, and principles from the Weber-Fechner Law. The QoE maximization problem is formulated as a Mixed Integer Programming (MIP) problem that jointly optimizes keyframe extraction ratio and resource allocation (i.e., bandwidth and CPU frequency), incorporating fairness. We employ the Deep Deterministic Policy Gradient (DDPG) algorithm as a reinforcement learning strategy. Evaluation with the Motion Capture Database demonstrates that our framework significantly reduces interactive latency, enhances QoE, and maintains fairness, achieving superior performance compared to baseline methods.

Hong Kong University of Science and Technology (HK)
Openalex Percentile: Top 74%
Image and Video Quality Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Intelligent Attention-Based QoE Enhancement for VR Interaction: Keyframe Extraction and Resource Allocation — Danny H. K. Tsang, Jiadong Yu, et al. · (2025) | TGRS Research Map | TGRS