Topological Relational Learning on Graphs

Yuzhou Chen, Baris Coskunuzer, Yulia Gel

Keywords: Topological relational learning, Graph neural networks, Persistence based graph representation, Robust graph learning

TL;DR: We introduce a new local topological representation of graph to enhance robustness of Graph Neural Networks in classification tasks and derive its theoretical guarrantees

Abstract: Graph neural networks (GNNs) have emerged as a powerful tool for graph classification and representation learning. However, GNNs tend to suffer from over-smoothing problems and are vulnerable to graph perturbations. To address these challenges, we propose a novel topological neural framework of topological relational inference (TRI) which allows for integrating higher-order graph information to GNNs and for systematically learning a local graph structure. The key idea is to rewire the original graph by using the persistent homology of the small neighborhoods of the nodes and then to incorporate the extracted topological summaries as the side information into the local algorithm. As a result, the new framework enables us to harness both the conventional information on the graph structure and information on higher order topological properties of the graph. We derive theoretical properties on stability of the new local topological representation of the graph and discuss its implications on the graph algebraic connectivity. The experimental results on node classification tasks demonstrate that the new TRI-GNN outperforms all 14 state-of-the-art baselines on 6 out 7 graphs and exhibit higher robustness to perturbations, yielding up to 10\% better performance under noisy scenarios.

Code Of Conduct: I certify that all co-authors of this work have read and commit to adhering to the NeurIPS Statement on Ethics, Fairness, Inclusivity, and Code of Conduct.

Code: https://github.com/TRI-GNN/TRI-GNN.git

Community Implementations: [ 1 code implementation](https://www.catalyzex.com/paper/arxiv:2110.15529/code)