On the Implicit Bias of Dropout

Poorya Mianjy, Raman Arora, René Vidal

Abstract: Algorithmic approaches endow deep learning systems with implicit bias that helps them generalize even in over-parametrized settings. In this paper, we focus on understanding such a bias induced in ...