SEPARATE: A Simple Low-rank Projection for Gradient Compression in Modern Large-scale Model Training Process

Open Webpage

Hanzhen Zhao, Xingyu Xie, Cong Fang, Zhouchen Lin

Published: 01 Jan 2025, Last Modified: 06 Nov 2025ICLR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0