Pruning-and-distillation: One-stage joint compression framework for CNNsclustering

Tao Niu, Yinglei Teng, Lei Jin, Panpan Zou, Yiding Liu

Abstract: Highlights•Integrate pruning and distillation into a one-stage framework for collaborative compression.•Reconstruct redundant filters instead of removing to preserve learned knowledge.•Equivalently remove reconstructed filters by the channel addition operation.•Distill with the original model to avoid mismatch problem in vanilla distillation.