Assessing Local Generalization Capability in Deep Models

Huan Wang, Nitish Shirish Keskar, Caiming Xiong, Richard Socher

Abstract: While it has not yet been proven, empirical evidence suggests that model generalization is related to local properties of the optima, which can be described via the Hessian. We connect model genera...