Integrated Intelligence for Human-Robot Teams

Jean Oh, Thomas M. Howard, Matthew R. Walter, Daniel Barber, Menglong Zhu, Sangdon Park, Arne Suppé, Luis E. Navarro-Serment, Felix Duvallet, Abdeslam Boularias, Oscar J. Romero, Jerry Vinokurov, Terence Keegan, Robert Dean, Craig Lennon, Barry A. Bodt, Marshal Childers, Jianbo Shi, Kostas Daniilidis, Nicholas Roy et al. (3 additional authors not shown)

Abstract: With recent advances in robotics technologies and autonomous systems, the idea of human-robot teams is gaining ever-increasing attention. In this context, our research focuses on developing an intelligent robot that can autonomously perform non-trivial, but specific tasks conveyed through natural language. Toward this goal, a consortium of researchers develop and integrate various types of intelligence into mobile robot platforms, including cognitive abilities to reason about high-level missions, perception to classify regions and detect relevant objects in an environment, and linguistic abilities to associate instructions with the robot’s world model and to communicate with human teammates in a natural way. This paper describes the resulting system with integrated intelligence and reports on the latest assessment.