Learning Dynamics of Linear Denoising Autoencoders

Arnu Pretorius, Steve Kroon, Herman Kamper

Abstract: Denoising autoencoders (DAEs) have proven useful for unsupervised representation learning, but a thorough theoretical understanding is still lacking of how the input noise influences learning. Here...