Panoramic Light Field Video Acquisition

Jing Lv, Feng Dai, Qiang Zhao, Hongliang Li, Yike Ma, Yongdong Zhang

Abstract: Due to the limited field of view (FOV), the light field cameras can only capture a portion of the scene. Although there are methods designed to increase the FOV of light field images, these approaches stitch multiple sequentially captured light field images into a panoramic one and are restricted to static scenes. In this paper, we present a panoramic light field video acquisition system for dynamic scenes. Our system consists of 48 light field cameras and can capture panoramic light field videos at 6.3 fps. Two challenging problems, i.e. large volume data transmission, storage and camera synchronization, have been solved in our system. By using the light field stitching algorithm, the generated panoramic light field videos have 9×9 angular resolution, 6283×1200 spatial resolution and 360°×70° FOV, enabling us to do video refocusing, video focus tracking and other features not supported by light field static images.