HMoRA: Making LLMs More Effective with Hierarchical Mixture of LoRA Experts

Open Webpage

Mengqi Liao, Wei Chen, Junfeng Shen, Shengnan Guo, Huaiyu Wan

Published: 01 Jan 2025, Last Modified: 05 Jun 2025ICLR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0