Recurrent Information Synthesis for Down-Sampling Based Video Coding

Chi Zhang, Ming Lu, You Li, Zhan Ma

Abstract: With the popularity of high-definition videos, down-sampling based video coding has emerged a proven efficient method. In this paper, we non-uniformly down-sample the videos for compression with having intra-coded frames at the original resolution and inter-coded frames at a down-scaled resolution. After decoding, a recurrent information synthesis (RIS) module is proposed to super-resolve the down-sampled frames using a reference pool. Such a reference pool is initialized using decoded intra-coded frame first, and then recurrently updated by measuring the multi-scale features. Experimental results show that the proposed RIS achieves an average 5.73% BD-Rate gain against the VVC anchor in Low-delay P (LDP) setting, outperforming the state-of-the-art approaches. Additionally, our method requires fewer parameters and provides faster inference, demonstrating improved computational efficiency.