How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation ObjectivesDownload PDFOpen Website

Xinpeng Wang, Leonie Weissweiler, Hinrich Schütze, Barbara Plank

Published: 01 Jan 2023, Last Modified: 12 Dec 2023ACL (2) 2023Readers: Everyone
0 Replies