FastQuery: Communication-efficient Embedding Table Query for Private LLMs inference

Open Webpage

Chenqi Lin, Tianshi Xu, Zebin Yang, Runsheng Wang, Ru Huang, Meng Li

Published: 01 Jan 2024, Last Modified: 11 Apr 2025DAC 2024EveryoneRevisionsBibTeXCC BY-SA 4.0