Transformers Provably Learn Sparse Token Selection While Fully-Connected Nets Cannot

Open Webpage

Zixuan Wang, Stanley Wei, Daniel Hsu, Jason D. Lee

Published: 01 Jan 2024, Last Modified: 14 May 2025ICML 2024EveryoneRevisionsBibTeXCC BY-SA 4.0