EPIC: Efficient Position-Independent Caching for Serving Large Language Models

Open Webpage

Junhao Hu, Wenrui Huang, Weidong Wang, Haoyi Wang, Tiancheng Hu, Qin Zhang, Hao Feng, Xusheng Chen, Yizhou Shan, Tao Xie

Published: 2025, Last Modified: 04 Jan 2026ICML 2025EveryoneRevisionsBibTeXCC BY-SA 4.0