What Algorithms can Transformers Learn? A Study in Length Generalization

Open Webpage

Hattie Zhou, Arwen Bradley, Etai Littwin, Noam Razin, Omid Saremi, Joshua M. Susskind, Samy Bengio, Preetum Nakkiran

Published: 01 Jan 2024, Last Modified: 14 May 2025ICLR 2024EveryoneRevisionsBibTeXCC BY-SA 4.0