RazorAttention: Efficient KV Cache Compression Through Retrieval Heads

Open Webpage

Hanlin Tang, Yang Lin, Jing Lin, Qingsen Han, Danning Ke, Shikuan Hong, Yiwu Yao, Gongyi Wang

Published: 01 Jan 2025, Last Modified: 14 May 2025ICLR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0