CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion

Open Webpage

Jiayi Yao, Hanchen Li, Yuhan Liu, Siddhant Ray, Yihua Cheng, Qizheng Zhang, Kuntai Du, Shan Lu, Junchen Jiang

Published: 2025, Last Modified: 27 Jan 2026EuroSys 2025EveryoneRevisionsBibTeXCC BY-SA 4.0