Towards Understanding Sharpness-Aware Minimization

Maksym Andriushchenko, Nicolas Flammarion

Abstract: Sharpness-Aware Minimization (SAM) is a recent training method that relies on worst-case weight perturbations which significantly improves generalization in various settings. We argue that the exis...