SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs

Open Webpage

Ruibo Fan, Xiangrui Yu, Peijie Dong, Zeyu Li, Gu Gong, Qiang Wang, Wei Wang, Xiaowen Chu

Published: 01 Jan 2025, Last Modified: 04 May 2025EuroSys 2025EveryoneRevisionsBibTeXCC BY-SA 4.0