3D Mesh Based Inter-Image Prediction for Image Set Compression

Hao Wu, Xiaoyan Sun, Jingyu Yang, Feng Wu

Abstract: A key problem in image set compression is inter-image prediction. Different from the conventional 2D transformation based methods, in this paper we propose a novel 3D mesh based inter-image prediction method. We reconstruct a 3D mesh from the images in the set as a compact representation of the photographed scene. Regarding the images as different projections of the mesh, we build coordinates mappings between images by the multi-view geometry. Exploiting the continuity of the mesh surface, we naturally model the occlusions in the scene and perform inter-image prediction with higher accuracy. The experimental results demonstrate that the proposed method outperforms the state-of-the-arts significantly.