Collaborative Autonomy through Analogical Comic Graphs

Matthew Evans Klenk, Shiwali Mohan, Johan de Kleer, Daniel G. Bobrow, Tom Hinrichs, Kenneth D. Forbus

Abstract: For more effective collaboration, users and autonomous systems should interact naturally. We propose that sketch-based interaction coupled with qualitative representations and analogy provides a natural interface for users and systems. We introduce comic graphs that capture tasks in terms of the temporal dynamics of the spatial configurations of relevant objects. This paper demonstrates, through a strategy simulation example, how these models could be learned by demonstration, transferred to new situations, and enable explanations.