The Dynamics of Learning: A Random Matrix Approach

Zhenyu Liao, Romain Couillet

Abstract: Understanding the learning dynamics of neural networks is one of the key issues for the improvement of optimization algorithms as well as for the theoretical comprehension of why deep neural nets w...