Testing 4K HDR-WCG Professional Video Content for Subjective Quality Using a Remote Testing Approac

Modern content is rapidly shifting from the standard dynamic range (SDR) color volume towards the high dynamic range and wide color gamut (HDR-WCG) color volume. It is thus crucial to have high-performance video quality metrics. However, existing subjective databases do not provide adequate test coverage for professional HDR-WCG video content. We describe a subjective video quality study aimed to be relevant for existing and near future HDR-WCG. Due to the COVID-19 pandemic, the experiment was designed for remote testing rather than a typical laboratory environment. We carefully analyzed the subjective results and concluded that obtaining comparable data reliability in our remote testing environment with a controlled laboratory environment is possible. This opens the door for large-scale video quality testing. We applied the subjective data set to compare image and video quality metrics such as video multi-method assessment fusion (VMAF), high dynamic range-visual difference predictor (HDR-VDP), and high dynamic range-visual quality measure (HDR-VQM). We identified several ways to improve the accuracy of VMAF on HDR-WCG content.