Differential Gated Self-Attention

Elpiniki Maria Lygizou, Radu Grosu

Published: 22 Sept 2025, Last Modified: 03 Jan 2026WiML @ NeurIPS 2025EveryoneRevisionsBibTeXCC BY 4.0
Keywords: self-attention, noise-cancelling, differential gated attention, lateral inhibition
Submission Number: 400