Solving Nonconvex-Nonconcave Min-Max Problems exhibiting Weak Minty Solutions
Abstract: We investigate a structured class of nonconvex-nonconcave min-max problems exhibiting so-called \emph{weak Minty} solutions, a notion which was only recently introduced, but is able to simultaneously capture different generalizations of monotonicity. We prove novel convergence results for a generalized version of the optimistic gradient method (OGDA) in this setting, matching the $1/k$ rate for the best iterate in terms of the squared operator norm recently shown for the extragradient method (EG). In addition we propose an adaptive step size version of EG, which does not require knowledge of the problem parameters.
Submission Length: Regular submission (no more than 12 pages of main content)
Changes Since Last Submission: fixed usage of `\citet` and `\citep`.
Code: https://github.com/AxelBohm/OGDA_for_weak_Minty
Assigned Action Editor: ~Peter_Richtarik1
License: Creative Commons Attribution 4.0 International (CC BY 4.0)
Submission Number: 648
Loading