The Loss Surface of Deep and Wide Neural Networks

Quynh Nguyen, Matthias Hein

Abstract: While the optimization problem behind deep neural networks is highly non-convex, it is frequently observed in practice that training deep networks seems possible without getting stuck in suboptimal...