Double Equivariance for Inductive Link Prediction for Both New Nodes and New Relation Types

Jianfei Gao, Yangze Zhou, Jincheng Zhou, Bruno Ribeiro

Keywords: Link Prediction, Double Permutation-Equivariance, Discrete Attributed Multigraph, Knowledge Graph, GNN

TL;DR: This work describes the doubly inductive link prediction task (over new nodes and new relation types in test) and introduce the associated double equivariant models

Abstract: The task of inductive link prediction in discrete attributed multigraphs (e.g., knowledge graphs, multilayer networks, heterogeneous networks, etc.) generally focuses on test predictions with solely new nodes but not both new nodes and new relation types. In this work, we formally define the task of predicting (completely) new nodes and new relation types in test as a doubly inductive link prediction task and introduce a theoretical framework for the solution. We start by defining the concept of double permutation-equivariant representations that are equivariant to permutations of both node identities and edge relation types. We then propose a general blueprint to design neural architectures that impose a structural representation of relations that can inductively generalize from training nodes and relations to arbitrarily new test nodes and relations without the need for adaptation, side information, or retraining. We also introduce the concept of distributionally double equivariant positional embeddings designed to perform the same task. Finally, we empirically demonstrate the capability of the two proposed models on a set of novel real-world benchmarks, showcasing relative performance gains of up to 41.40% on predicting new relations types compared to baselines.

Submission Number: 71