A Provably Effective Method for Pruning Experts in Fine-tuned Sparse Mixture-of-Experts

Open Webpage

Mohammed Nowaz Rabbani Chowdhury, Meng Wang, Kaoutar El Maghraoui, Naigang Wang, Pin-Yu Chen, Christopher D. Carothers

Published: 01 Jan 2024, Last Modified: 12 May 2025ICML 2024EveryoneRevisionsBibTeXCC BY-SA 4.0