Learning with Muscles: Benefits for Data-Efficiency and Robustness in Anthropomorphic TasksDownload PDF

16 Jun 2022, 10:45 (modified: 15 Nov 2022, 17:44)CoRL 2022 PosterReaders: Everyone
Student First Author: yes
Keywords: reinforcement learning, model predictive control, actuator morphology, morphological computation
TL;DR: We showcase the benefits of muscle-actuation for learning efficiency and robustness in a multitude of anthropomorphic tasks.
Abstract: Humans are able to outperform robots in terms of robustness, versatility, and learning of new tasks in a wide variety of movements. We hypothesize that highly nonlinear muscle dynamics play a large role in providing inherent stability, which is favorable to learning. While recent advances have been made in applying modern learning techniques to muscle-actuated systems both in simulation as well as in robotics, so far, no detailed analysis has been performed to show the benefits of muscles in this setting. Our study closes this gap by investigating core robotics challenges and comparing the performance of different actuator morphologies in terms of data-efficiency, hyperparameter sensitivity, and robustness.
Supplementary Material: zip
Website: https://sites.google.com/view/learning-with-muscles
Code: https://sites.google.com/view/learning-with-muscles
16 Replies