Instruction-Guided Autoregressive Neural Network Parameter Generation

Bedionita Soro, Bruno Andreis, Song Chong, Sung Ju Hwang

Published: 05 Mar 2025, Last Modified: 05 Mar 2025ICLR 2025 Workshop Weight Space Learning PosterEveryoneRevisionsBibTeXCC BY 4.0
Track: long paper (up to 8 pages)
Keywords: Weights Generation, Neural Network Parameter Generation, Weight Synthesis and Generation, VQVAE
TL;DR: Autoregressively generating neural network weights by sampling from pretrained model weight distributions encoded with a VQVAE.
Submission Number: 15