InferCept: Efficient Intercept Support for Augmented Large Language Model Inference

Open Webpage

Reyna Abhyankar, Zijian He, Vikranth Srivatsa, Hao Zhang, Yiying Zhang

Published: 01 Jan 2024, Last Modified: 05 Feb 2025ICML 2024EveryoneRevisionsBibTeXCC BY-SA 4.0