SparQ Attention: Bandwidth-Efficient LLM Inference

Open Webpage

Luka Ribar, Ivan Chelombiev, Luke Hudlass-Galley, Charlie Blake, Carlo Luschi, Douglas Orr

Published: 01 Jan 2024, Last Modified: 15 May 2025ICML 2024EveryoneRevisionsBibTeXCC BY-SA 4.0