Maximizing Intermediate Checkpoint Value in LLM Pretraining with Bayesian Optimization.

Deyuan Liu, Zecheng Wang, Bingning Wang, Weipeng Chen, Chunshan Li, Zhiying Tu, Dianhui Chu, Dianbo Sui