Online Speculative Decoding

Open Webpage

Xiaoxuan Liu, Lanxiang Hu, Peter Bailis, Alvin Cheung, Zhijie Deng, Ion Stoica, Hao Zhang

Published: 01 Jan 2024, Last Modified: 23 Jan 2025ICML 2024EveryoneRevisionsBibTeXCC BY-SA 4.0