Dropout distillation

Samuel Rota Bulò, Lorenzo Porzi, Peter Kontschieder

Abstract: Dropout is a popular stochastic regularization technique for deep neural networks that works by randomly dropping (i.e. zeroing) units from the network during training. This randomization process a...