MatryoshkaKV: Adaptive KV Compression via Trainable Orthogonal Projection

Open Webpage

Bokai Lin, Zihao Zeng, Zipeng Xiao, Siqi Kou, TianQi Hou, Xiaofeng Gao, Hao Zhang, Zhijie Deng

Published: 01 Jan 2025, Last Modified: 05 Oct 2025ICLR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0