A Lyapunov analysis for accelerated gradient methods: from deterministic to stochastic case

Maxime Laborde, Adam M. Oberman

Abstract: Recent work by Su, Boyd and Candes made a connection between Nesterov’s accelerated gradient descent method and an ordinary differential equation (ODE). We show that this connection can be extended...