Second-Order Optimization with Lazy Hessians

Nikita Doikov, El Mahdi Chayti, Martin Jaggi

Abstract: We analyze Newton’s method with lazy Hessian updates for solving general possibly non-convex optimization problems. We propose to reuse a previously seen Hessian for several iterations while comput...