Reconstructing Intensity Images from Binary Spatial Gradient Cameras

Suren Jayasuriya, Orazio Gallo, Jinwei Gu, Timo Aila, Jan Kautz

Abstract: Binary gradient cameras extract edge and temporal information directly on the sensor, allowing for low-power, low-bandwidth, and high-dynamic-range capabilities-all critical factors for the deployment of embedded computer vision systems. However, these types of images require specialized computer vision algorithms and are not easy to interpret by a human observer. In this paper we propose to recover an intensity image from a single binary spatial gradient image with a deep auto-encoder. Extensive experimental results on both simulated and real data show the effectiveness of the proposed approach.