ENAHPool: The Edge-Node Attention-based Hierarchical Pooling for Graph Neural Networks

Zhehan Zhao, Lu Bai, Lixin Cui, Ming Li, Ziyu Lyu, Lixiang Xu, Yue Wang, Edwin Hancock

TL;DR: We propose a novel graph pooling operation, namely the Edge-Node Attention-based Hierarchical Pooling (ENAHPool), for GNNs to learn graph representations.

Abstract: Graph Neural Networks (GNNs) have emerged as powerful tools for graph learning, and one key challenge arising in GNNs is the development of effective pooling operations for learning meaningful graph representations. In this paper, we propose a novel Edge-Node Attention-based Hierarchical Pooling (ENAHPool) operation for GNNs. Unlike existing cluster-based pooling methods that suffer from ambiguous node assignments and uniform edge-node information aggregation, ENAHPool assigns each node exclusively to a cluster and employs attention mechanisms to perform weighted aggregation of both node features within clusters and edge connectivity strengths between clusters, resulting in more informative hierarchical representations. To further enhance the model performance, we introduce a Multi-Distance Message Passing Neural Network (MD-MPNN) that utilizes edge connectivity strength information to enable direct and selective message propagation across multiple distances, effectively mitigating the over-squashing problem in classical MPNNs. Experimental results demonstrate the effectiveness of the proposed method.

Lay Summary: Graph-based structured data is prevalent in real world applications. How to accurately identify their categories is always a challenging problem arising in existing researches. The aim of this work is to propose a novel Edge-Node Attention-based Hierarchical Pooling method for graph classification. This approach can hierarchically assign the nodes into different clusters, and further adaptively aggregate both the node features within clusters as well as the edge connectivity strengths between clusters. As a result, the proposed approach is able to capture more informative hierarchical representations, enhancing the classification performance.

Primary Area: Deep Learning->Graph Neural Networks

Keywords: Graph Pooling

Submission Number: 4504