Optimization with First-Order Surrogate Functions

Julien Mairal

Abstract: In this paper, we study optimization methods consisting of iteratively minimizing surrogates of an objective function. By proposing several algorithmic variants and simple convergence analyses, we ...