FLAG n' FLARE: Fast Linearly-Coupled Adaptive Gradient Methods

Xiang Cheng, Fred Farbod Roosta, Stefan Palombo, Peter L. Bartlett, Michael W. Mahoney

Abstract: We consider first order gradient methods for effectively optimizing a composite objective in the form of a sum of smooth and, potentially, non-smooth functions. We present accelerated and adaptive ...