Mean Field Analysis of Deep Neural Networks

Justin A. Sirignano, Konstantinos Spiliopoulos

Abstract: We analyze multilayer neural networks in the asymptotic regime of simultaneously (a) large network sizes and (b) large numbers of stochastic gradient descent training iterations. We rigorously esta...