Knowledge Graph Simple Question Answering for Unseen Domains

Georgios Sidiropoulos, Nikos Voskarides, Evangelos Kanoulas

Keywords: Question Answering, Knowledge Graph, Domain Adaptation

TL;DR: A data-centric domain adaptation framework for KG question answering for unseen domains

Subject Areas: QuestionAnswering and Reasoning

Abstract: Knowledge Graph Simple Question Answering (KGSQA), in its standard form, does not take into account that human-curated question answering training data only cover a small subset of the relations that exist in a Knowledge Graph (KG), or even worse, that new domains covering unseen and rather different to existing domains relations are added to the KG. In this work, we study KGQA for first-order questions in a previously unstudied setting where new, unseen, domains are added during test time. In this setting, question-answer pairs of the new domain do not appear during training, thus making the task more challenging. We propose a data-centric domain adaptation framework that consists of a KGQA system that is applicable to new domains, and a sequence to sequence question generation method that automatically generates question-answer pairs for the new domain. Since the effectiveness of question generation for KGQA can be restricted by the limited lexical variety of the generated questions, we use distant supervision to extract a set of keywords that express each relation of the unseen domain and incorporate those in the question generation method. Experimental results demonstrate that our framework significantly improves over zero-shot baselines and is robust across domains.

Archival Status: Archival

Community Implementations: [ 1 code implementation](https://www.catalyzex.com/paper/arxiv:2005.12040/code)