Adversarial Synthetic Datasets for Neural Program Synthesis

Alexander Suh, Yuval Timen

Keywords: Program Synthesis, Synthetic Data, Evolutionary Algorithm

Abstract: Program synthesis is the task of automatically generating a program consistent with a given specification. A natural way to specify programs is to provide examples of desired input-output behavior, and many current program synthesis approaches have achieved impressive results after training on randomly generated input-output examples. However, recent work has discovered that some of these approaches generalize poorly to data distributions different from that of the randomly generated examples. We show that this problem applies to other state-of-the-art approaches as well and that current methods to counteract this problem are insufficient. We then propose a new, adversarial approach to control the bias of synthetic data distributions and show that it outperforms current approaches.

Code Of Ethics: I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics

One-sentence Summary: We propose an adversarial approach to generate synthetic data for program synthesis models.

Reviewed Version (pdf): https://openreview.net/references/pdf?id=kNoW-EwKYi