No Head Left Behind - Multi-Head Alignment Distillation for Transformers

Open Webpage

Tianyang Zhao, Kunwar Yashraj Singh, Srikar Appalaraju, Peng Tang, Vijay Mahadevan, R. Manmatha, Ying Nian Wu

Published: 01 Jan 2024, Last Modified: 09 May 2025AAAI 2024EveryoneRevisionsBibTeXCC BY-SA 4.0