Perceptual Issues in Mixed Reality: A Developer-oriented Perspective on Video See-Through Head-Mounted Displays

Video see-through (VST) head-mounted displays (HMDs) can address issues of optical see-through (OST) HMDs, like field of view and occlusion, but introduce latency, distortion, and resolution challenges. With the resurgence of VR, dedicated VST devices like Varjo XR-3 and Apple Vision Pro have gained popularity, enhancing AR and Cross Reality applications. This article investigates the issues researchers and developers currently face when using VST HMDs and provides firsthand information about conducting science with these devices through commentaries regarding each aspect. With these, we aim to give helpful insights about developing and conducting research with these devices.