Gumiho: A Hybrid Architecture to Prioritize Early Tokens in Speculative Decoding

Open Webpage

Jinze Li, Yixing Xu, Haiduo Huang, Xuanwu Yin, Dong Li, Edith C. H. Ngai, Emad Barsoum

Published: 2025, Last Modified: 07 Jan 2026ICML 2025EveryoneRevisionsBibTeXCC BY-SA 4.0