ResMoE: Space-efficient Compression of Mixture of Experts LLMs via Residual Restoration

Open Webpage

Mengting Ai, Tianxin Wei, Yifan Chen, Zhichen Zeng, Ritchie Zhao, Girish Varatkar, Bita Darvish Rouhani, Xianfeng Tang, Hanghang Tong, Jingrui He

Published: 01 Jan 2025, Last Modified: 31 May 2025KDD (1) 2025EveryoneRevisionsBibTeXCC BY-SA 4.0