Towards Democratizing LLMs: Investigating Multilingual Mixture-of-Experts Models

Aditi Khandelwal, Marius Mosbach, Verna Dankers, Siva Reddy, Golnoosh Farnadi

Published: 22 Sept 2025, Last Modified: 03 Jan 2026WiML @ NeurIPS 2025EveryoneRevisionsBibTeXCC BY 4.0
Keywords: multilingual LLMs, Mixture-of-Experts, Routing
Submission Number: 167