Self-supervised representation learning on manifoldsDownload PDF

Mar 08, 2021 (edited Apr 08, 2021)GTRL 2021 PosterReaders: Everyone
  • Keywords: manifold learning, representation learning, self-supervised learning
  • TL;DR: Adjusting representation learning algorithms to output an atlas of a manifold.
  • Abstract: We explore the use of a topological manifold, represented as a collection of charts, as the target space of neural network based representation learning tasks. This is achieved by a simple adjustment to the output of an encoder's network architecture plus the addition of a maximal mean discrepancy based loss function for regularization. Most algorithms in representation learning are easily adaptable to our framework and we demonstrate its effectiveness by adjusting SimCLR to have a manifold encoding space. Our experiments show that we obtain a substantial performance boost over the baseline for low dimensional encodings. Code for reproducing experiments is provided at
  • Poster: png
1 Reply