Second-Order Fine-Tuning without Pain for LLMs: A Hessian Informed Zeroth-Order Optimizer

Open Webpage

Yanjun Zhao, Sizhe Dang, Haishan Ye, Guang Dai, Yi Qian, Ivor W. Tsang

Published: 2025, Last Modified: 21 Jan 2026ICLR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0