End-to-End Synthesis of Neural Programs in Weight Space

Wenhao Li, Yudong Xu, Elias Boutros Khalil, Scott Sanner

Track: tiny / short paper (up to 4 pages)

Keywords: weight-space program synthesis, neural subroutines, meta-learning, zero-shot generalization

TL;DR: We present a zero-shot framework that synthesizes a transformer's weights for discrete arithmetic, e.g. (a+b) mod p, achieving near-perfect correctness with no post-hoc fine-tuning.

Submission Number: 43