Cyclic and Randomized Stepsizes Invoke Heavier Tails in SGD than Constant Stepsize

Open Webpage

Mert Gürbüzbalaban, Yuanhan Hu, Umut Simsekli, Lingjiong Zhu

Published: 01 Jan 2023, Last Modified: 15 May 2025Trans. Mach. Learn. Res. 2023EveryoneRevisionsBibTeXCC BY-SA 4.0