LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation

Open Webpage

Fangxun Shu, Yue Liao, Lei Zhang, Le Zhuo, Chenning Xu, Guanghao Zhang, Haonan Shi, Long Chan, Tao Zhong, Zhelun Yu, Wanggui He, Siming Fu, Haoyuan Li, Si Liu, Hongsheng Li, Hao Jiang

Published: 2025, Last Modified: 07 Jan 2026ICLR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0