Geometry of Program SynthesisDownload PDF

28 Sep 2020 (modified: 14 Jan 2021)ICLR 2021 Conference Blind SubmissionReaders: Everyone
  • Keywords: Program Synthesis, Singular Learning Theory, Bayesian Inference, MCMC
  • Abstract: We present a new perspective on program synthesis in which programs may be identified with singularities of analytic functions. As an example, Turing machines are synthesised from input-output examples by propagating uncertainty through a smooth relaxation of a universal Turing machine. The posterior distribution over weights is approximated using Markov chain Monte Carlo and bounds on the generalisation error of these models is estimated using the real log canonical threshold, a geometric invariant from singular learning theory.
  • One-sentence Summary: A new perspective on program synthesis using the geometry of singular learning theory.
  • Code Of Ethics: I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics
  • Supplementary Material: zip
9 Replies