Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models

Open Webpage

Keisuke Kamahori, Tian Tang, Yile Gu, Kan Zhu, Baris Kasikci

Published: 01 Jan 2025, Last Modified: 16 May 2025ICLR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0