Low-loss connection of weight vectors: distribution-based approaches

Ivan Anokhin, Dmitry Yarotsky

Abstract: Recent research shows that sublevel sets of the loss surfaces of overparameterized networks are connected, exactly or approximately. We describe and compare experimentally a panel of methods used t...