Computational Spectral-Depth Imaging with a Compact System

Mingde Yao, Zhiwei Xiong, Lizhi Wang, Dong Liu, Xuejin Chen

Abstract: In this paper, a compact imaging system is developed to enable simultaneous acquisition of the spectral and depth information in real-time with high resolution. We achieve this goal using only two commercial cameras and relying on an efficient computational reconstruction algorithm with deep learning. For the first time, this work allows 5D information (3D space + 1D spectrum + 1D time) of the target scene to be captured with a miniaturized apparatus and without active illumination.