Almost Tune-Free Variance Reduction

Bingcong Li, Lingda Wang, Georgios B. Giannakis

Abstract: The variance reduction class of algorithms including the representative ones, SVRG and SARAH, have well documented merits for empirical risk minimization problems. However, they require grid search...