Expressive Sign Equivariant Networks for Spectral Geometric Learning

Derek Lim, Joshua Robinson, Stefanie Jegelka, Yaron Lipman, Haggai Maron

Keywords: Equivariance, Spectral, Rigid Transformations, Graphs

TL;DR: We demonstrate applications of sign equivariance to eigenvector symmetries, and develop provably expressive sign equivariant neural networks.

Abstract:

Recent work has shown the utility of developing machine learning models that respect the symmetries of eigenvectors.
These works promote sign invariance, since for any eigenvector $v$ the negation $-v$ is also an eigenvector.
In this work, we demonstrate that sign equivariance is useful for applications such as building orthogonally equivariant models and link prediction. To obtain these benefits, we develop novel sign equivariant neural network architectures. These models are based on our analytic characterization of the sign equivariant polynomials and thus inherit provable expressiveness properties.

Community Implementations: [ 1 code implementation](https://www.catalyzex.com/paper/arxiv:2312.02339/code)