Variational Bayesian dropout: pitfalls and fixes

Jiri Hron, Alexander G. de G. Matthews, Zoubin Ghahramani

Abstract: Dropout, a stochastic regularisation technique for training of neural networks, has recently been reinterpreted as a specific type of approximate inference algorithm for Bayesian neural networks. T...