Towards Theoretical Analysis of Transformation Complexity of ReLU DNNs

Jie Ren, Mingjie Li, Meng Zhou, Shih-Han Chan, Quanshi Zhang

Abstract: This paper aims to theoretically analyze the complexity of feature transformations encoded in piecewise linear DNNs with ReLU layers. We propose metrics to measure three types of complexities of tr...