Multi-view modeling & synthesis

Chen Brestel, Shimon Ullman

Abstract: In this work we introduce a method for generating a complete object representation based on its cover by a set of 2D views. This view-based representation has applications in several areas such as object recognition, computer graphics and video compression. The notion of image-based modeling received considerable attention in recent years. The basic motivation is to avoid the computational-intensive process of acquiring a 3D model followed by rendering. Instead, the approach uses a number of model images taken from different poses of the 3D object or scene as a basis. From these views any pose can be synthesized directly. Prior work used a small number of views to represent the object from a limited range of viewing directions. In the current work, a complete model that allows a presentation of the object from any viewing direction is introduced. A second novel aspect of the current work is a method for obtaining correspondence between views using a special pattern illumination. The correspondence is obtained with complexity of O(Nlog(N)) where N is the number of pixels in the image.