Automatic Preparation of Sensory Effects: Managing Synchronization in Mulsemedia Applications

Marina Ivanov, Marcelo F. Moreno, Débora C. Muchaluat-Saade

Abstract: Traditional audiovisual multimedia applications can be synchronized with sensory effects to further enhance the users' quality of experience. These applications are named mulsemedia applications and stimulate other human senses, such as touch, smell, and taste. Some delays may occur when rendering sensory effects due to specific device capabilities and communication between the mulsemedia presentation engine (formatter) and actuators. In this context, this work proposes the automatic preparation of sensory effects to avoid synchronization faults during a mulsemedia application presentation. The automatic preparation of sensory effects depends on the effect type to be rendered. As proof of concept, we implemented the automatic preparation in the Ginga-NCL presentation engine. Furthermore, we present some use cases of the preparation mechanisms applied to sensory effects. Finally, an evaluation of our proposal is presented.