Attention Score is not All You Need for Token Importance Indicator in KV Cache Reduction: Value Also Matters

Download PDF
Open Webpage

Zhiyu Guo, Hidetaka Kamigaito, Taro Watanabe

Published: 01 Jan 2024, Last Modified: 17 Jul 2025EMNLP 2024EveryoneRevisionsBibTeXCC BY-SA 4.0