TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models

Open Webpage

Makoto Shing, Kou Misaki, Han Bao, Sho Yokoi, Takuya Akiba

Published: 01 Jan 2025, Last Modified: 16 May 2025ICLR 2025EveryoneRevisionsBibTeXCC BY-SA 4.0