OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models

Open Webpage

Fuzhao Xue, Zian Zheng, Yao Fu, Jinjie Ni, Zangwei Zheng, Wangchunshu Zhou, Yang You

Published: 01 Jan 2024, Last Modified: 05 Oct 2024ICML 2024EveryoneRevisionsBibTeXCC BY-SA 4.0