A Study on Knowledge Distillation from Weak Teacher for Scaling Up Pre-trained Language ModelsDownload PDFOpen Website

Hayeon Lee, Rui Hou, Jongpil Kim, Davis Liang, Sung Ju Hwang, Alexander Min

Published: 01 Jan 2023, Last Modified: 03 Oct 2023ACL (Findings) 2023Readers: Everyone
0 Replies