How to Train Your Neural ODE: the World of Jacobian and Kinetic Regularization

Chris Finlay, Jörn-Henrik Jacobsen, Levon Nurbekyan, Adam M. Oberman

Abstract: Training neural ODEs on large datasets has not been tractable due to the necessity of allowing the adaptive numerical ODE solver to refine its step size to very small values. In practice this leads...