ThinK: Thinner Key Cache by Query-Driven Pruning

Open Webpage

Yuhui Xu, Zhanming Jie, Hanze Dong, Lei Wang, Xudong Lu, Aojun Zhou, Amrita Saha, Caiming Xiong, Doyen Sahoo

Published: 01 Jan 2025, Last Modified: 15 May 2025ICLR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0