Variational Inference of Disentangled Latent Concepts from Unlabeled ObservationsDownload PDF

15 Feb 2018 (modified: 01 Mar 2023)ICLR 2018 Conference Blind SubmissionReaders: Everyone
Keywords: disentangled representations, variational inference
TL;DR: We propose a variational inference based approach for encouraging the inference of disentangled latents. We also propose a new metric for quantifying disentanglement.
Abstract: Disentangled representations, where the higher level data generative factors are reflected in disjoint latent dimensions, offer several benefits such as ease of deriving invariant representations, transferability to other tasks, interpretability, etc. We consider the problem of unsupervised learning of disentangled representations from large pool of unlabeled observations, and propose a variational inference based approach to infer disentangled latent factors. We introduce a regularizer on the expectation of the approximate posterior over observed data that encourages the disentanglement. We also propose a new disentanglement metric which is better aligned with the qualitative disentanglement observed in the decoder's output. We empirically observe significant improvement over existing methods in terms of both disentanglement and data likelihood (reconstruction quality).
Code: [![Papers with Code](/images/pwc_icon.svg) 2 community implementations](
Data: [CelebA](, [Chairs](
13 Replies