Reference frame list optimization algorithm in video coding by quality enhancement of the nearest picture

Abstract

Interframe prediction is a key module in video coding, which uses the samples in the reference frames to predict those in the current picture, thus helps to represent the complex video by transmitting a small amount of the prediction residual.In lossy video coding, the qualities of reference frames are affected by the quantization distortion, which lead to poor prediction accuracy and performance degradation.Targeted at the low latency video services, a reference frame list optimization algorithm was proposed, which enhanced the quality of the nearest reference frame by a deep learning-based convolutional neural network, and integrated the enhanced reference frame into the reference frame list to improve the accuracy of interframe prediction.Compared with H.265/HEVC reference software HM16.22, the proposed algorithm provides BD-rate savings of 9.06%, 14.92% and 13.19% for Y, Cb and Cr components, respectively.

Keywords

• H.265/HEVC;deep learning;interframe prediction;reference frame list