Combating the instability of mutual information-based losses via regularization

Kwanghee Choi, Siyeong Lee

Abstract: Notable progress has been made in numerous fields of machine learning based on neural network-driven mutual information (MI) bounds. However, utilizing the conventional MI-based losses is often cha...