On Dropout and Nuclear Norm Regularization

Poorya Mianjy, Raman Arora

Abstract: We give a formal and complete characterization of the explicit regularizer induced by dropout in deep linear networks with squared loss. We show that (a) the explicit regularizer is composed of an ...