MoS: Unleashing Parameter Efficiency of Low-Rank Adaptation with Mixture of Shards

Open Webpage

Sheng Wang, Liheng Chen, Pengan Chen, Jingwei Dong, Boyang Xue, Jiyue Jiang, Lingpeng Kong, Chuan Wu

Published: 01 Jan 2025, Last Modified: 18 May 2025ICLR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0