Exploring Influences of Appearance and Voice Realism of Virtual Humans on Communication Effectiveness in Social Virtual Reality

Yu Han, Yu Miao, Hao Sha, Yue Liu

Abstract: Virtual humans play a crucial role in elevating user experiences in Virtual Reality (VR). Despite ongoing technological advancements, achieving highly realistic virtual humans with entirely natural behaviors remains a challenge. This paper explores how the appearance and voice realism of virtual humans influence communication effectiveness within social VR scenarios. Our preliminary results indicate the significant impact of alterations in appearance and voice realism on communication effectiveness. We observe that a cross-modal realism mismatch between appearance and voice can hamper effective communication. This research provides valuable insights for designing virtual humans and improving the quality of social communication in VR environments.