TCRA-LLM: Token Compression Retrieval Augmented Large Language Model for Inference Cost Reduction

Junyi Liu, Liangzhi Li, Tong Xiang, Bowen Wang, Yiming Qian