How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained TransformersDownload PDFOpen Website

Michael Hassid, Hao Peng, Daniel Rotem, Jungo Kasai, Ivan Montero, Noah A. Smith, Roy Schwartz

Published: 01 Jan 2022, Last Modified: 12 May 2023EMNLP (Findings) 2022Readers: Everyone
0 Replies