Empowering parameter-efficient transfer learning by recognizing the kernel structure in self-attention

Yifan Chen, Devamanyu Hazarika, Mahdi Namazifar, Yang Liu, Di Jin, Dilek Hakkani-Tur