Marginalised Gaussian Processes with Nested SamplingDownload PDF

21 May 2021, 20:51 (edited 26 Oct 2021)NeurIPS 2021 PosterReaders: Everyone
  • Keywords: Gaussian Processes, nested sampling, Bayesian inference
  • TL;DR: We propose nested sampling as a promising means of marginalising kernel hyperparameters.
  • Abstract: Gaussian Process models are a rich distribution over functions with inductive biases controlled by a kernel function. Learning occurs through optimisation of the kernel hyperparameters using the marginal likelihood as the objective. This work proposes nested sampling as a means of marginalising kernel hyperparameters, because it is a technique that is well-suited to exploring complex, multi-modal distributions. We benchmark against Hamiltonian Monte Carlo on time-series and two-dimensional regression tasks, finding that a principled approach to quantifying hyperparameter uncertainty substantially improves the quality of prediction intervals.
  • Supplementary Material: pdf
  • Code Of Conduct: I certify that all co-authors of this work have read and commit to adhering to the NeurIPS Statement on Ethics, Fairness, Inclusivity, and Code of Conduct.
  • Code: https://github.com/frgsimpson/nsampling
13 Replies

Loading