MoCoKGC: Momentum Contrast Entity Encoding for Knowledge Graph Completion
Abstract: In recent years, numerous studies have sought to enhance the capabilities of pretrained language models (PLMs) for Knowledge Graph Completion (KGC) tasks by integrating structural information from knowledge graphs.
However, existing approaches have not effectively combined the structural attributes of knowledge graphs with the textual descriptions of entities to generate robust entity encodings.
To address this issue, this paper proposes MoCoKGC (Momentum Contrast Entity Encoding for Knowledge Graph Completion), which incorporates three primary encoders: the entity-relation encoder, the entity encoder, and the momentum entity encoder.
Momentum contrast learning not only provides more negative samples but also allows for the gradual updating of entity encodings.
Consequently, we reintroduce the generated entity encodings into the encoder to incorporate the graph's structural information.
Additionally, MoCoKGC enhances the inferential capabilities of the entity-relation encoder through deep prompts of relations.
On the standard evaluation metric, Mean Reciprocal Rank (MRR), the MoCoKGC model demonstrates superior performance, achieving a 7.1% improvement on the WN18RR dataset and an 11% improvement on the Wikidata5M dataset, while also surpassing the current best model on the FB15k-237 dataset.
Through a series of experiments, this paper thoroughly examines the role and contribution of each component and parameter of the model.
Paper Type: Long
Research Area: NLP Applications
Research Area Keywords: knowledge graphs; contrastive learning; prompting;
Contribution Types: NLP engineering experiment
Languages Studied: English
Submission Number: 1638
Loading