Dynamic Memory Compression: Retrofitting LLMs for Accelerated Inference

Open Webpage

Piotr Nawrot, Adrian Lancucki, Marcin Chochowski, David Tarjan, Edoardo M. Ponti

Published: 01 Jan 2024, Last Modified: 14 May 2025ICML 2024EveryoneRevisionsBibTeXCC BY-SA 4.0