Rate Distortion For Model Compression: From Theory To Practice

Weihao Gao, Yu-Han Liu, Chong Wang, Sewoong Oh

Abstract: The enormous size of modern deep neural net-works makes it challenging to deploy those models in memory and communication limited scenarios. Thus, compressing a trained model without a significant ...