Learning to Generate Samples from Noise through Infusion TrainingDownload PDF

Jun 20, 2021 (edited Mar 03, 2017)ICLR 2017 conference submissionReaders: Everyone
  • TL;DR: We learn a markov transition operator acting on inputspace, to denoise random noise into a target distribution. We use a novel target injection technique to guide the training.
  • Abstract: In this work, we investigate a novel training procedure to learn a generative model as the transition operator of a Markov chain, such that, when applied repeatedly on an unstructured random noise sample, it will denoise it into a sample that matches the target distribution from the training set. The novel training procedure to learn this progressive denoising operation involves sampling from a slightly different chain than the model chain used for generation in the absence of a denoising target. In the training chain we infuse information from the training target example that we would like the chains to reach with a high probability. The thus learned transition operator is able to produce quality and varied samples in a small number of steps. Experiments show competitive results compared to the samples generated with a basic Generative Adversarial Net.
  • Keywords: Deep learning, Unsupervised Learning
  • Conflicts: umontreal.ca, polymtl.ca
19 Replies