INQUIRE: INteractive Querying for User-aware Informative REasoning

Tesca Fitzgerald, Pallavi Koppol, Patrick Callaghan, Russell Quinlan Jun Hei Wong, Reid Simmons, Oliver Kroemer, Henny Admoni

Keywords: Active Learning, Learning from Demonstration, Human-Robot Interaction

TL;DR: INQUIRE is a robot learning system that optimizes over multiple query types: demonstrations, preferences, corrections, and binary rewards. It results in faster, more robust learning than baselines that use single or fixed-pattern query types.

Abstract: Research on Interactive Robot Learning has yielded several modalities for querying a human for training data, including demonstrations, preferences, and corrections. While prior work in this space has focused on optimizing the robot's queries within each interaction type, there has been little work on optimizing over the selection of the interaction type itself. We present INQUIRE, the first algorithm to implement and optimize over a generalized representation of information gain across multiple interaction types. Our evaluations show that INQUIRE can dynamically optimize its interaction type (and respective optimal query) based on its current learning status and the robot's state in the world, resulting in more robust performance across tasks in comparison to state-of-the art baseline methods. Additionally, INQUIRE allows for customizable cost metrics to bias its selection of interaction types, enabling this algorithm to be tailored to a robot's particular deployment domain and formulate cost-aware, informative queries.

Student First Author: no

Code: https://github.com/HARPLab/inquire