An Automated Domain Understanding Technique for Knowledge Graph Generation

Dimitrios Christofidellis, Matteo Manica, Leonidas Georgopoulos, Hans Vandierendonck

Keywords: Knowledge Graphs, Graph Inference, Transformers, NLP, Wisdom of Crowds, Attention Mechanism

Abstract: Domain-specific Knowledge Graph (KG) generation is a labor intensive task usually orchestrated and supervised by subject matter experts. Herein, we propose a strategy to automate the generation process following a two-step approach. Initially, the structure of the domain of interest is inferred from the corpus in the form of a metagraph. Afterwards, once the domain structure has been discovered, named entity recognition (NER) and relation extraction (RE) models can be used to generate a domain-specific KG. We argue why the automated definition of the domain's structure as a first step is beneficial both in terms of construction time and quality of the generated graph. Furthermore, we present a machine learning approach, based on Transformers, to infer the structure of a corpus's domain. The proposed method is extensively validated on three public datasets (WebNLG, NYT and DocRED) by comparing it with two reference methods using CNNs and RNNs. Lastly, we demonstrate how this work lays the foundation for fully automated and unsupervised KG generation.

One-sentence Summary: Domain-specific KG generation is a daunting task requiring heavy manual curation, here we propose a method based on Transformers to define the domain structure that enables automated KG construction in conjunction with standard NER and RE pipelines.

Code Of Ethics: I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics

Reviewed Version (pdf): https://openreview.net/references/pdf?id=OMZZD0eu-J