On Variational Bounds of Mutual Information

Ben Poole, Sherjil Ozair, Aäron van den Oord, Alex Alemi, George Tucker

Abstract: Estimating and optimizing Mutual Information (MI) is core to many problems in machine learning, but bounding MI in high dimensions is challenging. To establish tractable and scalable objectives, re...