HyperNetwork Approximating Future Parameters for Time Series Forecasting under Temporal Drifts

Jaehoon Lee, Chan Kim, Gyumin Lee, Haksoo Lim, Jeongwhan Choi, Kookjin Lee, Dongeun Lee, Sanghyun Hong, Noseong Park

Keywords: Time series forecasting, Hypernetwork, Temporal drifts

TL;DR: We address problems caused by temporal drifts with hypernetworks which understand an underlying hidden dynamics and generate the parameters of target time series models.

Abstract: Models for time series forecasting require the ability to extrapolate from previous observations. Yet, extrapolation is challenging, especially when the data spanning several periods is under temporal drifts where each period has a different distribution. To address this problem, we propose HyperGPA, a hypernetwork that generates a target model's parameters that are expected to work well (i.e., be an optimal model) for each period. HyperGPA discovers an underlying hidden dynamics which causes temporal drifts over time, and generates the model parameters for a target period, aided by the structures of computational graphs. In comprehensive evaluations, we show that target models whose parameters are generated by HyperGPA are up to 64.1\% more accurate than baselines.

Submission Number: 29