MLP-Attention: Improving Transformer Architecture with MLP Attention Weights

Alireza Morsali, Moein Heidari, Samin Heydarian, Tohid Abedini