Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

Open Webpage

Yichao Fu, Peter Bailis, Ion Stoica, Hao Zhang

Published: 01 Jan 2024, Last Modified: 01 Oct 2024ICML 2024EveryoneRevisionsBibTeXCC BY-SA 4.0