Why learn if you can infer? Robot arm control with Hierarchical Active Inference
Keywords: Neuro-inspired robot control, active Inference, kinematics, hierarchical models
TL;DR: This paper presents a hierarchical active inference agent for n-DOF robot arm control, that outperforms the RL baseline in reaching tasks as degrees of freedom increase. It demonstrates collision avoidance and link length estimation during execution.
Abstract: Recently deep reinforcement learning (RL) approaches have become successful in a wide range of domains, including robot control. Using learning instead of classical control approaches is appealing, as it avoids dealing with redundancy in over-actuated arms, hard-coding obstacle avoidance, and performing inverse kinematics calculations. However, this comes at the cost of excessive training data to fit a black-box model. In this paper, we cast motor control as an inference problem on a generative model that pertains to the robot arm's kinematic chain structure, which might be a more bio-mimetic implementation. We demonstrate that we retain both the attractive properties of RL and the efficiency of more classical forward kinematics approaches without requiring expensive training, achieving superior success rates as the degrees of freedom of the arm increase.
Submission Number: 23
Loading