Leveraging Recursive Gumbel-Max Trick for Approximate Inference in Combinatorial SpacesDownload PDF

21 May 2021, 20:50 (edited 11 Jan 2022)NeurIPS 2021 PosterReaders: Everyone
  • Keywords: structured discrete latent variable, gumbel-max trick, perturb-and-map, gradient estimation, score function
  • TL;DR: Unbiased score-function-based gradient estimators for structured discrete latent variables
  • Abstract: Structured latent variables allow incorporating meaningful prior knowledge into deep learning models. However, learning with such variables remains challenging because of their discrete nature. Nowadays, the standard learning approach is to define a latent variable as a perturbed algorithm output and to use a differentiable surrogate for training. In general, the surrogate puts additional constraints on the model and inevitably leads to biased gradients. To alleviate these shortcomings, we extend the Gumbel-Max trick to define distributions over structured domains. We avoid the differentiable surrogates by leveraging the score function estimators for optimization. In particular, we highlight a family of recursive algorithms with a common feature we call stochastic invariant. The feature allows us to construct reliable gradient estimates and control variates without additional constraints on the model. In our experiments, we consider various structured latent variable models and achieve results competitive with relaxation-based counterparts.
  • Supplementary Material: pdf
  • Code Of Conduct: I certify that all co-authors of this work have read and commit to adhering to the NeurIPS Statement on Ethics, Fairness, Inclusivity, and Code of Conduct.
18 Replies

Loading