Learning Neuro-Symbolic Relational Transition Models for Bilevel Planning

Rohan Chitnis, Tom Silver, Joshua B. Tenenbaum, Tomas Perez, Leslie Pack Kaelbling

Keywords: task and motion planning, neuro-symbolic, relational, model-based

TL;DR: We introduce Neuro-Symbolic Relational Transition Models (NSRTs), a novel class of transition models for continuous states & actions that are data-efficient to learn, compatible with powerful robotic planning methods, and generalizable over objects.

Abstract: In robotic domains, learning and planning are complicated by continuous state spaces, continuous action spaces, and long task horizons. In this work, we address these challenges with Neuro-Symbolic Relational Transition Models (NSRTs), a novel class of models that are data-efficient to learn, compatible with powerful robotic planning methods, and generalizable over objects. NSRTs have both symbolic and neural components, enabling a bilevel planning scheme where symbolic AI planning in an outer loop guides continuous planning with neural models in an inner loop. Experiments in four robotic planning domains show that NSRTs can be learned after only tens or hundreds of training episodes, and then used for fast planning in new tasks that require up to 60 actions and involve many more objects than were seen during training.