Loss Landscape Degeneracy and Stagewise Development in Transformers

Open Webpage

Jesse Hoogland, George Wang, Matthew Farrugia-Roberts, Liam Carroll, Susan Wei, Daniel Murfet

Published: 2025, Last Modified: 12 Jan 2026Trans. Mach. Learn. Res. 2025EveryoneRevisionsBibTeXCC BY-SA 4.0