Attention-based Learning for Multiple Relation Patterns in Knowledge Graph Embedding

Anonymous

Paper Link: https://openreview.net/forum?id=6PVn09blitv

Paper Type: Long paper (up to eight pages of content + unlimited references and appendices)

Abstract: Relations in knowledge graphs often exhibit multiple relation patterns. Various knowledge graph embedding methods have been proposed to modeling the properties in relation patterns. However, relations with a certain relation pattern actually only account for a small proportion in the knowledge graph. Relations with no explicit relation patterns also show complicated properties which is rarely studied. To this end, we argue that a property of a relation should either be global or be partial, and propose an Attention-based Learning framework for Multi-relation Patterns (ALMP) for expressing complex properties of relations. ALMP adopts a set of affine transformations for expressing corresponding global relation properties. Furthermore, ALMP utilizes a module of attention mechanism to integrate the representations. Experimental results show that the ALMP model outperforms baseline models on the link prediction task.