Solving ODE with Universal Flows: Approximation Theory for Flow-Based ModelsDownload PDF

26 Feb 2020, 20:49 (modified: 14 Jun 2022, 20:46)ICLR 2020 Workshop ODE/PDE+DL PosterReaders: Everyone
Keywords: Normalizing flows, ODE, neural ODE, universal approximation
TL;DR: We we invertible neural networks to approximate solutions to ODEs to show they are universal density approximators.
Abstract: Normalizing flows are powerful invertible probabilistic models that can be used to translate two probability distributions, in a way that allows us to efficiently track the change of probability density. However, to trade for computational efficiency in sampling and in evaluating the log-density, special parameterization designs have been proposed at the cost of representational expressiveness. In this work, we propose to use ODEs as a framework to establish universal approximation theory for certain families of flow-based models.
1 Reply