A Toolkit for Creating Intelligent Virtual Humans in Extended Reality

Download PDF
Open Webpage

Fariba Mostajeran, Ke Li, Sebastian Rings, Lucie Kruse, Erik Wolf, Susanne Schmidt, Michael Arz, Joan Llobera, Pierre Nagorny, Caecilia Charbonnier, Hannes Fassold, Xenxo Alvarez, André Tavares, Nuno Santos, João Orvalho, Sergi Fernández, Frank Steinicke

Published: 2025, Last Modified: 09 Nov 2025VR Workshops 2025EveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: This paper introduces an initial implementation and a preliminary evaluation of a toolkit for providing Intelligent Virtual Humans in Extended Reality (XR) environments. These virtual humans may serve as avatars for users, known as Smart Avatars, or artificial agents, known as Intelligent Virtual Agents. The presented toolkit consists of five modules that contribute to producing realistic human-to-human and human-to-agent interactions in XR. The primary focus lies in enabling natural, multimodal communication and interaction through a range of expressive capabilities, including speech, facial expressions, gaze tracking, and full-body animations. By enhancing the realism and responsiveness of virtual humans, this paper strives to facilitate their use in a variety of metaverse applications.