CARAI: A Formative Evaluation Methodology for VR Simulations

Alec G. Moore, Xinyu Hu, James Coleman Eubanks, Afham Ahmed Aiyaz, Ryan P. McMahan

Abstract: Virtual reality (VR) has a long history of being used to simulate real-world tasks, often for training and educational purposes. Yet, developing a VR system that is usable and effective is not trivial and is still a challenging task. We present a methodology for formatively evaluating the usability of VR simulations by capturing a real-world task, automating data logging, running a rigorous user study, analyzing subtask user performances, and inspecting subpar subtasks for usability issues.