A feature-based approach for saliency estimation of omni-directional images

Federica Battisti, Sara Baldoni, Michele Brizzi, Marco Carli

Abstract: Omni-directional imaging records the visual information from any direction with respect to a given view-point. It is gaining consumers’ popularity due to fast spreading of low-cost devices both for acquisition and rendering. The possibility to render the whole surrounding space represents a further step towards immersivity, thus providing the user with the illusion of physically being in a virtual environment. The understanding of visual attention mechanisms for these images is a relevant topic for processing, coding, and exploiting such data. In this contribution, a saliency model for omni-directional images is presented. It is based on the combination of low-level and semantic features. The first ones account for texture, viewport saliency, hue and saturation, while the second are used to take into account the impact of the presence of human subjects on the saliency. The proposed model has been tested in the “Salient360! Visual attention modeling for 360° Images” Grand Challenge. The model, the achieved results, and finding/discussions are here presented.