Learning on LoRAs: GL-Equivariant Processing of Low-Rank Weight Spaces for Large Finetuned Models

Theo Putterman, Derek Lim, Yoav Gelberg, Stefanie Jegelka, Haggai Maron

Published: 05 Mar 2025, Last Modified: 05 Mar 2025ICLR 2025 Workshop Weight Space Learning PosterEveryoneRevisionsBibTeXCC BY 4.0
Track: long paper (up to 8 pages)
Keywords: LoRA, Weight-space learning, Equivariance, Foundation models, Finetuning
Submission Number: 51