OmniDepth: Dense Depth Estimation for Indoors Spherical Panoramas

Nikolaos Zioulis, Antonis Karakottas, Dimitrios Zarpalas, Petros Daras

Abstract: Recent work on depth estimation up to now has only focused on projective images ignoring $${360}^{\circ }$$ content which is now increasingly and more easily produced. We show that monocular depth estimation models trained on traditional images produce sub-optimal results on omnidirectional images, showcasing the need for training directly on $${360}^{\circ }$$ datasets, which however, are hard to acquire. In this work, we circumvent the challenges associated with acquiring high quality $${360}^{\circ }$$ datasets with ground truth depth annotations, by re-using recently released large scale 3D datasets and re-purposing them to $${360}^{\circ }$$ via rendering. This dataset, which is considerably larger than similar projective datasets, is publicly offered to the community to enable future research in this direction. We use this dataset to learn in an end-to-end fashion the task of depth estimation from $${360}^{\circ }$$ images. We show promising results in our synthesized data as well as in unseen realistic images.