A Free-Energy Principle for Representation Learning

Yansong Gao, Pratik Chaudhari

Abstract: This paper employs a formal connection of machine learning with thermodynamics to characterize the quality of learnt representations for transfer learning. We discuss how information-theoretic func...