To Err is Humanoid; to Collaborate, Divine: A Transitional Reality Interface for Error Replay and Correction in Industrial Robotics

Lorian Marshall, Jordan Allspaw, Holly A. Yanco

Keywords: Failure Detection and Recovery, Virtual Reality and Interfaces, Industrial Robots, Human-Robot Interaction

TL;DR: This paper presents an error correction system for robots, based on error replay, using augmented reality (AR) and virtual reality (VR).

Abstract: Real-time fault detection and error diagnosis are crucial to enhance trust and reduce process delays in the emerging landscape of single-human multiple-robot systems (SHMRS) within the manufacturing industry. In this paper, we propose a hybrid reality interface that utilizes real-time VR-AR transitions alongside an action sequence storage system for robot error replay. An interactive digital twin of the robotic platform, complemented by visualizations of recorded sensor data, enables operators to troubleshoot faults and adjust behaviors in an immersive environment. We also outline a future user study designed to compare this user-centric interface with traditional control methods. This work offers significant potential for advancing human-robot collaboration by facilitating a comprehensive, retrospective analysis of robot behavior.

Submission Number: 11