Exploiting Student Parallelism for Low-latency GPU Inference of BERT-like Models in Online Services

Open Webpage

Weiyan Wang, Yilun Jin, Yiming Zhang, Victor Junqiu Wei, Han Tian, Li Chen, Jinbao Xue, Yangyu Tao, Di Wang, Kai Chen

Published: 2025, Last Modified: 25 Jan 2026KDD (2) 2025EveryoneRevisionsBibTeXCC BY-SA 4.0