MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained TransformersOpen Website

Wenhui Wang, Hangbo Bao, Shaohan Huang, Li Dong, Furu Wei

2021 (modified: 08 Jan 2023)ACL/IJCNLP (Findings) 2021Readers: Everyone
0 Replies