TSPipe: Learn from Teacher Faster with PipelinesDownload PDFOpen Website

Hwijoon Lim, Yechan Kim, Sukmin Yun, Jinwoo Shin, Dongsu Han

2022 (modified: 15 Nov 2022)ICML 2022Readers: Everyone
Abstract: The teacher-student (TS) framework, training a (student) network by utilizing an auxiliary superior (teacher) network, has been adopted as a popular training paradigm in many machine learning schem...
0 Replies