To Err is Humanoid; to Collaborate, Divine: A Transitional Reality Interface for Error Replay and Correction in Industrial Robotics

17 Feb 2025 (modified: 28 Feb 2025)HRI 2025 Workshop VAM SubmissionEveryoneRevisionsBibTeXCC BY 4.0
Keywords: Failure Detection and Recovery, Virtual Reality and Interfaces, Industrial Robots, Human-Robot Interaction
TL;DR: This paper presents an error correction system for robots, based on error replay, using augmented reality (AR) and virtual reality (VR).
Abstract: Real-time fault detection and error diagnosis are crucial to enhance trust and reduce process delays in the emerging landscape of single-human multiple-robot systems (SHMRS) within the manufacturing industry. In this paper, we propose a hybrid reality interface that utilizes real-time VR-AR transitions alongside an action sequence storage system for robot error replay. An interactive digital twin of the robotic platform, complemented by visualizations of recorded sensor data, enables operators to troubleshoot faults and adjust behaviors in an immersive environment. We also outline a future user study designed to compare this user-centric interface with traditional control methods. This work offers significant potential for advancing human-robot collaboration by facilitating a comprehensive, retrospective analysis of robot behavior.
Submission Number: 11
Loading

OpenReview is a long-term project to advance science through improved peer review with legal nonprofit status. We gratefully acknowledge the support of the OpenReview Sponsors. © 2025 OpenReview