Neighbor-Aware Feature-Driven Motion Compensation for Learned Video Compression

Learned video compression (LVC) methods typically align spatial-temporal transformation features with optical flow to perform motion compensation. However, existing LVC methods typically rely on a single reference feature to provide local detail features. This ignores global structural information, resulting in limited capabilities when dealing with fast motion or occlusion scenarios. In addition, with the encoding of P-frames, errors accumulate, leading to a degradation in reconstruction quality. To address these issues, we propose the Neighbor-Aware Feature-Driven Motion Compensation (NAFD-MC) that utilizes the spatial-temporal correlations of the neighboring features to explore the global structural information and the local detail information. Furthermore, we introduce the Synergy Filtering Module (SFM) to enhance inter-frame consistency and alleviate the error accumulation. Experimental results demonstrate that our method outperforms the H.266/VVC reference software VTM-13.2 in public benchmark datasets.