Density estimation using Real NVP

Laurent Dinh, Jascha Sohl-Dickstein, Samy Bengio

Nov 04, 2016 (modified: Feb 14, 2017) ICLR 2017 conference submission readers: everyone
  • Abstract: Unsupervised learning of probabilistic models is a central yet challenging problem in machine learning. Specifically, designing models with tractable learning, sampling, inference and evaluation is crucial in solving this task. We extend the space of such models using real-valued non-volume preserving (real NVP) transformations, a set of powerful invertible and learnable transformations, resulting in an unsupervised learning algorithm with exact log-likelihood computation, exact sampling, exact inference of latent variables, and an interpretable latent space. We demonstrate its ability to model natural images on four datasets through sampling, log-likelihood evaluation and latent variable manipulations.
  • TL;DR: Efficient invertible neural networks for density estimation and generation
  • Keywords: Deep learning, Unsupervised Learning
  • Conflicts: umontreal.ca, google.com

Loading