The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry

Open Webpage

Michael Zhang, Kush Bhatia, Hermann Kumbong, Christopher Ré

Published: 01 Jan 2024, Last Modified: 04 Mar 2025ICLR 2024EveryoneRevisionsBibTeXCC BY-SA 4.0