Capsule Graph Neural Network

Zhang Xinyi, Lihui Chen

Abstract:

The high-quality node embeddings learned from the Graph Neural Networks (GNNs) have been applied to a wide range of node-based applications and some of them have achieved state-of-the-art (SOTA) performance. However, when applying node embeddings learned from GNNs to generate graph embeddings, the scalar node representation may not suffice to preserve the node/graph properties efficiently, resulting in sub-optimal graph embeddings.

Inspired by the Capsule Neural Network (CapsNet), we propose the Capsule Graph Neural Network (CapsGNN), which adopts the concept of capsules to address the weakness in existing GNN-based graph embeddings algorithms. By extracting node features in the form of capsules, routing mechanism can be utilized to capture important information at the graph level. As a result, our model generates multiple embeddings for each graph to capture graph properties from different aspects. The attention module incorporated in CapsGNN is used to tackle graphs with various sizes which also enables the model to focus on critical parts of the graphs.

Our extensive evaluations with 10 graph-structured datasets demonstrate that CapsGNN has a powerful mechanism that operates to capture macroscopic properties of the whole graph by data-driven. It outperforms other SOTA techniques on several graph classification tasks, by virtue of the new instrument.

Keywords: CapsNet, Graph embedding, GNN

TL;DR: Inspired by CapsNet, we propose a novel architecture for graph embeddings on the basis of node features extracted from GNN.

Data: [COLLAB](https://paperswithcode.com/dataset/collab), [ENZYMES](https://paperswithcode.com/dataset/enzymes), [IMDB-BINARY](https://paperswithcode.com/dataset/imdb-binary), [IMDB-MULTI](https://paperswithcode.com/dataset/imdb-multi), [MUTAG](https://paperswithcode.com/dataset/mutag), [NCI1](https://paperswithcode.com/dataset/nci1), [PROTEINS](https://paperswithcode.com/dataset/proteins)