INQUIRE: INteractive Querying for User-aware Informative REasoningDownload PDF

16 Jun 2022, 10:45 (modified: 16 Nov 2022, 04:16)CoRL 2022 PosterReaders: Everyone
Student First Author: no
Keywords: Active Learning, Learning from Demonstration, Human-Robot Interaction
TL;DR: INQUIRE is a robot learning system that optimizes over multiple query types: demonstrations, preferences, corrections, and binary rewards. It results in faster, more robust learning than baselines that use single or fixed-pattern query types.
Abstract: Research on Interactive Robot Learning has yielded several modalities for querying a human for training data, including demonstrations, preferences, and corrections. While prior work in this space has focused on optimizing the robot's queries within each interaction type, there has been little work on optimizing over the selection of the interaction type itself. We present INQUIRE, the first algorithm to implement and optimize over a generalized representation of information gain across multiple interaction types. Our evaluations show that INQUIRE can dynamically optimize its interaction type (and respective optimal query) based on its current learning status and the robot's state in the world, resulting in more robust performance across tasks in comparison to state-of-the art baseline methods. Additionally, INQUIRE allows for customizable cost metrics to bias its selection of interaction types, enabling this algorithm to be tailored to a robot's particular deployment domain and formulate cost-aware, informative queries.
Supplementary Material: zip
23 Replies