Testing Human-Robot Interaction in Virtual Reality: Experience from a Study on Speech Act Classification

Sara Kaszuba, Sandeep Reddy Sabbella, Francesco Leotta, Pascal Serrarens, Daniele Nardi

Keywords: virtual reality, human-robot interaction, smart agriculture, user evaluation

Abstract: In the recent years, an increasing number of Human-Robot Interaction (HRI) approaches have been implemented and evaluated in Virtual Reality (VR), as it allows to speed-up design iterations and make it safer for the final user to evaluate and master the HRI primitives. However, identifying the most suitable VR experience is not straightforward. In this work, in particular, we evaluate how, in a smart agriculture scenario, immersive and non-immersive VR are perceived by users with respect to a speech act understanding task. In particular, we collect opinions and suggestions from the 81 participants involved in both experiments to highlight the strengths and weaknesses of the two different experiences.

Submission Number: 11