ForecastPFN: Universal Forecasting for HealthcareDownload PDF

Published: 01 Mar 2023, Last Modified: 22 Apr 2023ICLR 2023 TSRL4H PosterReaders: Everyone
Keywords: time-series forecasting, prior-data fitted networks, zero-shot forecasting
TL;DR: We devise ForecastPFN, the first universal zero-shot forecasting model, pretrained purely on synthetic data, for healthcare and other forecasting applications.
Abstract: The vast majority of time-series forecasting approaches require a training dataset. There is very recent work on zero-shot forecasting---pretraining on one series and evaluating on another---yet its performance is inconsistent depending on the training dataset. In this work, we take a different approach and devise ForecastPFN, the first universal zero-shot model, pretrained purely on synthetic data. Drawing inspiration from TabPFN, a recent breakthrough in tabular data, ForecastPFN is the first forecasting model to approximate Bayesian inference. To accomplish this, we design a synthetic time-series distribution with local and global trends, and noise. Through experiments on multiple datasets, we show that ForecastPFN achieves competitive performance without ever seeing the training datasets, compared to popular methods that were fully trained on the training dataset.
Anonymity: We agree to keep the submission (including any supplements and/or code) anonymous.
Formatting: We confirm that we read and complied with the author's instructions.
0 Replies

Loading