SeLCA: Self-Supervised Learning of Canonical AxisDownload PDF

Published: 07 Nov 2022, Last Modified: 05 May 2023NeurReps 2022 PosterReaders: Everyone
Keywords: SO(3)-equivariance, point cloud understanding, rotation invariance
TL;DR: We propose SeLCA, a self-supervised pipeline to predict the canonical axis of 3D point clouds. Aligning point clouds using SeLCA shows improvements on downstream tasks, while being robust to point cloud corruptions compared to existing methods.
Abstract: Robustness to rotation is critical for point cloud understanding tasks as point cloud features can be affected dramatically with respect to prevalent rotation changes. In this work, we introduce a novel self-supervised learning framework, dubbed SeLCA, that predicts a canonical axis of point clouds in a probabilistic manner. In essence, we propose to learn rotational-equivariance by predicting the canonical axis of point clouds, and achieve rotational-invariance by aligning the point clouds using their predicted canonical axis. When integrated into a rotation-sensitive pipeline, SeLCA achieves competitive performances on the ModelNet40 classification task under unseen rotations. Our proposed method also shows high robustness to various real-world point cloud corruptions presented by the ModelNet40-C dataset, compared to the state-of-the-art rotation-invariant method.
4 Replies