Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning

Open Webpage

Ted Zadouri, Ahmet Üstün, Arash Ahmadian, Beyza Ermis, Acyr Locatelli, Sara Hooker

Published: 01 Jan 2024, Last Modified: 19 May 2025ICLR 2024EveryoneRevisionsBibTeXCC BY-SA 4.0