Revisiting Weight Initialization of Deep Neural Networks

Maciej Skorski, Alessandro Temperoni, Martin Theobald

Abstract: The proper {\em initialization of weights} is crucial for the effective training and fast convergence of {\em deep neural networks} (DNNs). Prior work in this area has mostly focused on the princip...