MagicDec: Breaking the Latency-Throughput Tradeoff for Long Context Generation with Speculative Decoding

Published: 01 Jan 2025, Last Modified: 16 May 2025ICLR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0
Loading