Learning The Delay in Delay Differential Equations

Robert Stephany, Maria Antonia Oprea, Gabriella Torres Nothaft, Mark Walth, Arnaldo Rodriguez-Gonzalez, William A Clark

Keywords: Delay Differential Equations, System Identification, Machine Learning, Adjoint Sensitivity Method

TL;DR: We use the adjoint sensivity method to learn the delay and paramaters of a delay differential equation directly from data.

Abstract: The intersection of machine learning and dynamical systems has generated considerable interest recently. Neural Ordinary Differential Equations (NODEs) represent a rich overlap between these fields. In this paper, we develop a continuous-time neural network approach based on Delay Differential Equations (DDEs). Our model uses the adjoint sensitivity method to learn the model parameters and delay directly from data. Our approach builds upon recent developments in NODEs and extends earlier neural DDE models, which assume the delay is known a priori. We rigorously justify our adjoint method and use numerical experiments to demonstrate our algorithm's ability to learn delays and parameters from data. Since the delay is rarely known \emph{a. priori}, our approach advances system identification of DDEs from real-world data.

Submission Number: 51