CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion

Open Webpage

Jiayi Yao, Hanchen Li, Yuhan Liu, Siddhant Ray, Yihua Cheng, Qizheng Zhang, Kuntai Du, Shan Lu, Junchen Jiang

Published: 01 Jan 2025, Last Modified: 29 May 2025EuroSys 2025EveryoneRevisionsBibTeXCC BY-SA 4.0