Fast Variance Reduction Method with Stochastic Batch Size

Xuanqing Liu, Cho-Jui Hsieh

Abstract: In this paper we study a family of variance reduction methods with randomized batch size—at each step, the algorithm first randomly chooses the batch size and then selects a batch of samples to con...