Dissecting Outlier Dynamics in LLM NVFP4 Pretraining

Open Webpage

Peijie Dong, Ruibo Fan, Yuechen Tao, Di Mou, Wenhu Hu, Zhenheng Tang, Yinghao Yu, Jiamang Wang, Wenbo Su, Guodong Yang, Liping Zhang, Xiaowen Chu, Baochun Li, Bo Li

Published: 2026, Last Modified: 08 May 2026CoRR 2026EveryoneRevisionsBibTeXCC BY-SA 4.0