LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation

Open Webpage

Fangxun Shu, Yue Liao, Lei Zhang, Le Zhuo, Chenning Xu, Guanghao Zhang, Haonan Shi, Long Chan, Tao Zhong, Zhelun Yu, Wanggui He, Siming Fu, Haoyuan Li, Si Liu, Hongsheng Li, Hao Jiang

Published: 01 Jan 2025, Last Modified: 12 Nov 2025ICLR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0