SARAH-M: A fast stochastic recursive gradient descent algorithm via momentum

Zhuang Yang

Abstract: Highlights•The efficacy of the variance reduced method with momentum is verified.•An adaptive variance reduced method with momentum is proposed.•The convergence properties of the proposed methods are provided.•Experimental results show great promise in standard machine learning tasks.