Weight Copy and Low-Rank Adaptation for Few-Shot Distillation of Vision Transformers.

Diana-Nicoleta Grigore, Mariana-Iuliana Georgescu, Jon Álvarez Justo, Tor Arne Johansen, Andreea Iuliana Ionescu, Radu Tudor Ionescu