Statistical Modeling Based Fast Rate Distortion Estimation Algorithm for HEVC

Xiang Meng, Xiaofeng Huang, Haibing Yin, Shengsheng Zheng, Shiqi Wang

Abstract: Rate distortion optimization (RDO) is the basis for algorithm optimization in video coding [1], such as mode decision, rate control and etc. Minimizing the rate distortion coding cost is usually employed to determine the optimal coding parameters such as quantization level, coding mode, and etc. However, rate and distortion calculations for optimal solution decision from massive possible candidates suffer from dramatically high computation complexity. To resolve this problem, this paper proposes a fast TU level rate model with higher accuracy by fully imitating the behavior pattern hid in entropy.