Heteroscedastic Temporal Variational Autoencoder For Irregularly Sampled Time Series

Satya Narayan Shukla, Benjamin Marlin

Keywords: irregular sampling, uncertainty, imputation, interpolation, multivariate time series, missing data, variational autoencoder

Abstract: Irregularly sampled time series commonly occur in several domains where they present a significant challenge to standard deep learning models. In this paper, we propose a new deep learning framework for probabilistic interpolation of irregularly sampled time series that we call the Heteroscedastic Temporal Variational Autoencoder (HeTVAE). HeTVAE includes a novel input layer to encode information about input observation sparsity, a temporal VAE architecture to propagate uncertainty due to input sparsity, and a heteroscedastic output layer to enable variable uncertainty in the output interpolations. Our results show that the proposed architecture is better able to reflect variable uncertainty through time due to sparse and irregular sampling than a range of baseline and traditional models, as well as recently proposed deep latent variable models that use homoscedastic output layers.

One-sentence Summary: We present a new deep learning architecture for probabilistic interpolation of irregularly sampled time series.