Discovering and Explaining the Representation Bottleneck of DNNS

Huiqi Deng, Qihan Ren, Hao Zhang, Quanshi Zhang

Abstract: This paper explores the bottleneck of feature representations of deep neural networks (DNNs), from the perspective of the complexity of interactions between input variables encoded in DNNs. To this...