On the Connection Between Learning Two-Layer Neural Networks and Tensor Decomposition

Marco Mondelli, Andrea Montanari

Abstract: We establish connections between the problem of learning a two-layer neural network and tensor decomposition. We consider a model with feature vectors $x$, $r$ hidden units with weights $w_i$ and o...