Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN

Open Webpage

Pengxiang Li, Lu Yin, Shiwei Liu

Published: 01 Jan 2025, Last Modified: 15 May 2025ICLR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0