A Formal Framework for Understanding Length Generalization in Transformers

Open Webpage

Xinting Huang, Andy Yang, Satwik Bhattamishra, Yash Sarrof, Andreas Krebs, Hattie Zhou, Preetum Nakkiran, Michael Hahn

Published: 2025, Last Modified: 25 Jan 2026ICLR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0