Exploring the Properties and Structure of Real Knowledge Graphs across Scientific Disciplines

Published: 28 Oct 2023, Last Modified: 11 Nov 2023NeurIPS 2023 Workshop AI4Science Withdrawn SubmissionEveryoneRevisionsBibTeX
Keywords: graphs, knowledge graphs, graph properties, evaluation, benchmarks, language models
TL;DR: An exploration of the properties and structure of real KGs across scientific domains with recommendations for model development and evaluation
Abstract: Despite the recent popularity of knowledge graph (KG) related tasks and benchmarks such as KG embeddings, link prediction, entity alignment and their use in many domains, the structure and properties of real KGs are not well studied. In this paper, we perform a large scale comparative study of 29 real KG datasets from diverse domains such as the natural sciences, medicine, and NLP to analyze their properties and structural patterns. Based on our findings we make recommendations regarding KG-based model development and evaluation. We believe that the rich structural information contained in KGs can benefit the development of better KG models across fields and we hope this study will contribute to breaking down the existing data silos between different scientific disciplines (e.g., biomedicine, ML/NLP, ’AI for Sciences’).
Submission Track: Highlight
Submission Number: 169