A Perceptual Rate Control Algorithm Based on JND for Screen Content Video

The rate control algorithm is designed for natural video by default in video-coding standards. However, computer-generated screen content video (SCV) is very different from natural video captured by a camera, with many different statistical characteristics, such as sharp edges, thin lines, and flat area. This will lead to a difference in the focus of the human visual system (HVS) when viewing on-screen content video. Especially in various sensor data visualization applications such as intelligent display terminals, industrial monitoring and human–computer interaction interfaces, screen content video carries key information collected and reconstructed by image sensors, vision sensors and multimodal sensors. Its edge structures and local details directly affect the interpretation accuracy and application reliability of sensor information. Therefore, it is crucial to investigate perceptual rate control methods that integrate both video content characteristics and human visual perception properties, which possesses substantial theoretical and practical significance. In this paper, we propose a perceptual rate control algorithm for screen content video based on just-noticeable distortion (JND) which is established on the edge profile reconstruction with tolerable variations. First of all, target bit rate allocation for the frame level and CTU level is based on a perceptual weight which is calculated on the JND factor and reconstruction edge character. Secondly, under the constraint of the JND model, an intra rate-distortion (RD) model is established under the constraint of the JND model. The similarity between reference frames and reconstructed frames is taken as feedback in this model. Finally, the proposed rate control algorithm (JND–perceptual rate control (PRC)) is integrated to the existing rate control framework in High-Efficiency Video Coding–Screen Content Coding (HEVC-SCC) for improving the coding efficiency. The experimental results show that the proposed algorithm achieves better bit control precision than the platform, as well as improves the R-D performance of screen content video. In particular, compared with the HEVC-SCC reference software, the coding performance is improved by 3.09 dB on average, the bit rate is saved by 26.51% on average, and the average bit rate mismatch is within 1.159%.