An Error Resilient Depth Map Coding Scheme Using Adaptive Wyner-Ziv Frame

Xiangkai Liu, Qiang Peng, Xiao Wu, Lei Zhang, Xu Xia, Lingyu Duan

Abstract: Depth information is one of the most important parameters in three dimensional videos (3DV). While transmitted through error-prone networks, the distortion in depth map due to packet loss will lead to a geometric error during the process of Depth Image Based Rendering (DIBR) and affect the rendered video quality. In this paper, we propose an error resilient depth map coding scheme using adaptive Wyner-Ziv (WZ) frames. For each depth frame, whether to be encoded into a Wyner-Ziv frame is decided by a joint source-channel R-D optimization (JSC-RDO) algorithm. JSC-RDO involves in the end-to-end distortion model of depth coding and the estimation of expected rate and distortion of WZ coding. Motion information of the corresponding color video are used to correct the depth error and generate the side information for WZ coding. The Lagrange multiplier used in JSC-RDO was derived taking into account both the packet-loss environment and the rendered view distortion. Experimental results show that the proposed error resilient scheme achieves a better overall R-D performance than existing schemes.