Accelerating Convolutional Neural Networks using Iterative Two-Pass Decomposition

Anonymous

Abstract: We present the iterative two-pass decomposition flow to accelerate existing convolutional neural networks (CNNs). The proposed rank selection algorithm can effectively determine the proper ranks of the target convolutional layers for the low rank approximation. Our two-pass CP-decomposition helps prevent from the instability problem. The iterative flow makes the decomposition of the deeper networks systematic. The experiment results shows that VGG16 can be accelerated with a 6.2x measured speedup while the accuracy drop remains only 1.2%.

TL;DR: We present the iterative two-pass CP decomposition flow to effectively accelerate existing convolutional neural networks (CNNs).

Keywords: Convolutional Neural Networks, CNN, CP Decomposition, Low Rank Approximation

Community Implementations: [ 2 code implementations](https://www.catalyzex.com/paper/accelerating-convolutional-neural-networks/code)

Withdrawal: Confirmed