Geometric algebra transformers for large 3D meshes via cross-attention

Julian Suk, Pim De Haan, Baris Imre, Jelmer M. Wolterink

Track: Extended abstract

Keywords: Geometric algebra, transformers, group equivariance, biomedical engineering

Abstract: Surface and volume meshes of 3D anatomical structures are widely used in biomedical engineering and medicine. The advent of machine learning enabled viable applications which come with the unique challenge of applying deep neural networks to large 3D meshes. In this work, we scale the recently introduced geometric algebra transformers (GATr) to meshes with hundreds of thousands of vertices by projection to a coarser set of vertices via cross-attention. The resulting neural network inherits GATr's equivariance under rotation, translation and reflection, which are desirable properties when dealing with 3D objects.

Submission Number: 66