Optimal Sparsity of Mixture-of-Experts Language Models for Reasoning Tasks

Open Webpage

Taishi Nakamura, Satoki Ishikawa, Masaki Kawamura, Takumi Okamoto, Daisuke Nohara, Jun Suzuki, Rio Yokota

Published: 01 Jan 2025, Last Modified: 13 Nov 2025CoRR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0