SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs

Published: 01 Jan 2025, Last Modified: 04 May 2025EuroSys 2025EveryoneRevisionsBibTeXCC BY-SA 4.0
Loading

OpenReview is a long-term project to advance science through improved peer review with legal nonprofit status. We gratefully acknowledge the support of the OpenReview Sponsors. © 2025 OpenReview