Solving Nonconvex-Nonconcave Min-Max Problems exhibiting Weak Minty Solutions

Published: 13 Mar 2023, Last Modified: 13 Mar 2023Accepted by TMLREveryoneRevisionsBibTeX
Abstract: We investigate a structured class of nonconvex-nonconcave min-max problems exhibiting so-called \emph{weak Minty} solutions, a notion which was only recently introduced, but is able to simultaneously capture different generalizations of monotonicity. We prove novel convergence results for a generalized version of the optimistic gradient method (OGDA) in this setting, matching the $1/k$ rate for the best iterate in terms of the squared operator norm recently shown for the extragradient method (EG). In addition we propose an adaptive step size version of EG, which does not require knowledge of the problem parameters.
License: Creative Commons Attribution 4.0 International (CC BY 4.0)
Submission Length: Regular submission (no more than 12 pages of main content)
Changes Since Last Submission: fixed usage of `\citet` and `\citep`.
Assigned Action Editor: ~Peter_Richtarik1
Submission Number: 648