Learning Multi-resolution Functional Maps with Spectral Attention for Robust Shape Matching

Lei Li, Nicolas Donati, Maks Ovsjanikov

Keywords: Non-rigid shape matching, functional map, multi-resolution, spectral attention

TL;DR: Our work introduces a novel non-rigid shape matching framework based on multi-resolution functional maps with spectral attention.

Abstract: In this work, we present a novel non-rigid shape matching framework based on multi-resolution functional maps with spectral attention. Existing functional map learning methods all rely on the critical choice of the spectral resolution hyperparameter, which can severely affect the overall accuracy or lead to overfitting, if not chosen carefully. In this paper, we show that spectral resolution tuning can be alleviated by introducing spectral attention. Our framework is applicable in both supervised and unsupervised settings, and we show that it is possible to train the network so that it can adapt the spectral resolution, depending on the given shape input. More specifically, we propose to compute multi-resolution functional maps that characterize correspondence across a range of spectral resolutions, and introduce a spectral attention network that helps to combine this representation into a single coherent final correspondence. Our approach is not only accurate with near-isometric input, for which a high spectral resolution is typically preferred, but also robust and able to produce reasonable matching even in the presence of significant non-isometric distortion, which poses great challenges to existing methods. We demonstrate the superior performance of our approach through experiments on a suite of challenging near-isometric and non-isometric shape matching benchmarks.

Community Implementations: [ 2 code implementations](https://www.catalyzex.com/paper/arxiv:2210.06373/code)