Heterophily-informed Message Passing
Abstract: Graph neural networks (GNNs) are known to be vulnerable to oversmoothing due to their implicit homophily assumption. We mitigate this problem with a novel scheme that regulates the aggregation of messages, modulating the type and extent of message passing locally thereby preserving both the low and high-frequency components of information. Our approach relies solely on learnt embeddings, obviating the need for auxiliary labels, thus extending the benefits of heterophily-aware embeddings to broader applications, e.g. generative modelling. Our experiments, conducted across various data sets and GNN architectures, demonstrate performance enhancements and reveal heterophily patterns across standard classification benchmarks. Furthermore, application to molecular generation showcases notable performance improvements on chemoinformatics benchmarks.
Submission Length: Regular submission (no more than 12 pages of main content)
Changes Since Last Submission: Manuscript for camera-ready submission
Code: https://github.com/AaltoML/heterophily-imp
Assigned Action Editor: ~Petar_Veličković1
Submission Number: 3904
Loading