On the Optimization and Generalization of Multi-head Attention

Open Webpage

Puneesh Deora, Rouzbeh Ghaderi, Hossein Taheri, Christos Thrampoulidis

Published: 01 Jan 2024, Last Modified: 30 Sept 2024Trans. Mach. Learn. Res. 2024EveryoneRevisionsBibTeXCC BY-SA 4.0