Pruning Redundant Mappings in Transformer Models via Spectral-Normalized Identity Prior

Zi Lin, Jeremiah Z. Liu, Zi Yang, Nan Hua, Dan Roth

Abstract: Zi Lin, Jeremiah Liu, Zi Yang, Nan Hua, Dan Roth. Findings of the Association for Computational Linguistics: EMNLP 2020. 2020.