Transformers Learn to Implement Multi-step Gradient Descent with Chain of Thought

Open Webpage

Jianhao Huang, Zixuan Wang, Jason D. Lee

Published: 01 Jan 2025, Last Modified: 14 May 2025ICLR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0