Real-time 360° panoramic views using BiCa360, the fast rotating dynamic vision sensor to up to 10 rotations per Sec

Ahmed Nabil Belbachir, Manfred Mayerhofer, Daniel Matolin, J. Colineau

Abstract: This paper presents a novel smart camera BiCa360 for real-time 360° panoramic views using a rotating dynamic vision sensor at up to 10 rotations per sec. The system consists of (1) a dual-line dynamic vision sensor generating events at high temporal resolution, on-chip time stamping (1μs resolution), having a high dynamic range and the sparse visual coding of the information, (2) a high-speed mechanical device rotating at up to 10 revolutions per sec (rps) where the sensor is mounted and (3) a real-time embedded software for panoramic reconstruction of the 360° panoramic views. Within this work, we show the capabilities of the system in terms of data quality (scene reconstruction). We made several experiments to assess the angular resolution as well as the visual quality of the data for rotations ranging from 1 to 10 rps. All evaluations were performed on natural scene with ambient illuminations. Within the live demonstration, we will show BiCa360 providing 360° panoramic views of the natural scene in real-time and at different rotations.