Mollifying Networks

Çaglar Gülçehre, Marcin Moczulski, Francesco Visin, Yoshua Bengio

Abstract: We are proposing a new continuation method for neural networks, that starts from optimizing a convex objective function and gradually during the training the function evolves into more non-convex function.