Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

Open Webpage

Mengzhou Xia, Tianyu Gao, Zhiyuan Zeng, Danqi Chen

Published: 01 Jan 2024, Last Modified: 01 Oct 2024ICLR 2024EveryoneRevisionsBibTeXCC BY-SA 4.0