Optimization-Based Separations for Neural Networks

Itay Safran, Jason D. Lee

Abstract: Depth separation results propose a possible theoretical explanation for the benefits of deep neural networks over shallower architectures, establishing that the former possess superior approximatio...