A Hardware-Efficient Post-Processing Algorithm for Motion Compensated Frame Rate Up-Conversion

Hang Wang, Tiancheng Wang, Yunqi Mi, Hongbin Sun, Nanning Zheng

Abstract: Post-processing is an important module in motion compensated frame rate up-conversion design, and has a direct impact on the image quality of interpolated frame. However, how to balance between image quality and computational efficiency is still very challenging for post-processing, especially in hardware design. This paper proposes a hardware-efficient post-processing algorithm which leverages the temporal and spatial constraints to locally refine interpolated pixels. Moreover, we employ the quantization and approximation techniques to further reduce the computational intensity of the proposed post-processing algorithm. The quality of interpolated frame has been greatly improved both in objective and subjective aspects. The proposed post-processing algorithm is extensively evaluated by a set of video test sequences. Evaluation results demonstrate that, compared with the reference designs, the proposed algorithm can improve PSNR by at least 1.69 dB with comparable computational complexity.