Variational multiple shooting for Bayesian ODEs with Gaussian processesDownload PDF

Published: 20 May 2022, Last Modified: 05 May 2023UAI 2022 OralReaders: Everyone
Keywords: Gaussian processes, ordinary differential equations, dynamical systems, Bayesian inference
TL;DR: We introduce a method for efficiently performing Bayesian inference on unknown ODEs using Gaussian processes
Abstract: Recent machine learning advances have proposed black-box estimation of $\textit{unknown continuous-time system dynamics}$ directly from data. However, earlier works are based on approximative solutions or point estimates. We propose a novel Bayesian nonparametric model that uses Gaussian processes to infer posteriors of unknown ODE systems directly from data. We derive sparse variational inference with decoupled functional sampling to represent vector field posteriors. We also introduce a probabilistic shooting augmentation to enable efficient inference from arbitrarily long trajectories. The method demonstrates the benefit of computing vector field posteriors, with predictive uncertainty scores outperforming alternative methods on multiple ODE learning tasks.
Supplementary Material: zip
5 Replies