Work in Progress: Teaching a Pipetting Task to a Robot Using Natural Gestures with Haptic Feedback in Augmented Reality
Keywords: human-robot interaction, augmented reality, gesture input, haptic feedback
TL;DR: Describing work in progress for an AR robot teaching system to teach a pipetting task.
Abstract: Collaborative robotics in laboratory automation can foster reproducibility, efficiency, and innovation. Augmented reality methods are a promising approach to fostering intuitive interaction with collaborative robotic systems, This paper presents a robot teaching system for teaching a pipetting task to a cobot suited to a laboratory environment. The system uses a head-mounted display and a smart glove device offering an intuitive teaching method leveraging natural gestures and haptic feedback. We outline the current state of our work, detailing the implementation of different abstraction levels for the pipetting interaction assigning liquids for dispensation from beakers to microplates. Additionally, we present planned steps to finalize the system and introduce a study design aimed at better understanding the effects of abstraction levels in visualization and gestures on the user experience.
Submission Number: 17
Loading