Learning through Dialogue Interactions by Asking Questions

Jiwei Li, Alexander H. Miller, Sumit Chopra, Marc'Aurelio Ranzato, Jason Weston

TL;DR: We investigate how a bot can benefit from interacting with users and asking questions.

Abstract: A good dialogue agent should have the ability to interact with users by both responding to questions and by asking questions, and importantly to learn from both types of interactions. In this work, we explore this direction by designing a simulator and a set of synthetic tasks in the movie domain that allow such interactions between a learner and a teacher. We investigate how a learner can benefit from asking questions in both offline and online reinforcement learning settings, and demonstrate that the learner improves when asking questions. Our work represents a first step in developing such end-to-end learned interactive dialogue agents.

Keywords: Natural language processing

Conflicts: fb.com, stanford.edu

Community Implementations: [ 1 code implementation](https://www.catalyzex.com/paper/arxiv:1612.04936/code)