Snip: single-Shot Network Pruning based on Connection sensitivity

Namhoon Lee, Thalaiyasingam Ajanthan, Philip H. S. Torr

Abstract: We present a new approach, SNIP, that is simple, versatile and interpretable; it prunes irrelevant connections for a given task at single-shot prior to training and is applicable to a variety of neural network models without modifications.