Learning from Frustration: Torsor CNNs on Graphs

Daiyuan Li, Shreya Arya, Robert Ghrist

Keywords: Geometric Deep Learning, Equivariant Neural Networks, Network Sheaves, Group Synchronization, Frustration Loss.

TL;DR: This paper introduces Torsor CNNs, a framework that connects local geometric equivariance on graphs to synchronization theory, yielding both novel equivariant layers and a practical geometric regularizer.

Abstract: Most equivariant neural networks rely on a single global symmetry, limiting their use in domains where symmetries are instead local. We introduce Torsor CNNs, a framework for learning on graphs with local symmetries encoded as edge potentials—group-valued transformations between neighboring coordinate frames. We establish that this geometric construction is fundamentally equivalent to the classical group synchronization problem, yielding: (1) a Torsor Convolutional Layer that is provably equivariant to local changes in coordinate frames, and (2) the frustration loss—a standalone geometric regularizer that encourages locally equivariant representations when added to any NN's training objective. The Torsor CNN framework unifies and generalizes several architectures—including classical CNNs and Gauge CNNs on manifolds—by operating on arbitrary graphs without requiring a global coordinate system or smooth manifold structure. We establish the mathematical foundations of this framework and demonstrate its applicability to multi-view 3D recognition, where relative camera poses naturally define the required edge potentials.

Submission Number: 95