Open Peer Review. Open Publishing. Open Access. Open Discussion. Open Directory. Open Recommendations. Open API. Open Source.
Deep Learning with Sets and Point Clouds
Siamak Ravanbakhsh, Jeff Schneider, Barnabas Poczos
Nov 04, 2016 (modified: Jan 17, 2017)ICLR 2017 conference submissionreaders: everyone
Abstract:We introduce a simple permutation equivariant layer for deep learning with set structure. This type of layer, obtained by parameter-sharing, has a simple implementation and linear-time complexity in the size of each set. We use deep permutation-invariant networks to perform point-could classification and MNIST digit summation, where in both cases the output is invariant to permutations of the input. In a semi-supervised setting, where the goal is make predictions for each instance within a set, we demonstrate the usefulness of this type of layer in set-outlier detection as well as semi-supervised learning with clustering side-information.
TL;DR:Parameter-sharing for permutation-equivariance and invariance with applications to point-cloud classification.