Mimetic Initialization of MLPs

Asher Trockman, J Zico Kolter

Published: 05 Mar 2025, Last Modified: 05 Mar 2025ICLR 2025 Workshop Weight Space Learning PosterEveryoneRevisionsBibTeXCC BY 4.0
Track: tiny / short paper (up to 4 pages)
Keywords: initialization, mlps, multilayer perceptrons, mimetic initialization, convnext, weight space, weight analysis
Submission Number: 53