Geometry of Program Synthesis

James Clift, Daniel Murfet, James Wallbridge

Keywords: Program Synthesis, Singular Learning Theory, Bayesian Inference, MCMC

Abstract: We present a new perspective on program synthesis in which programs may be identified with singularities of analytic functions. As an example, Turing machines are synthesised from input-output examples by propagating uncertainty through a smooth relaxation of a universal Turing machine. The posterior distribution over weights is approximated using Markov chain Monte Carlo and bounds on the generalisation error of these models is estimated using the real log canonical threshold, a geometric invariant from singular learning theory.

One-sentence Summary: A new perspective on program synthesis using the geometry of singular learning theory.

Code Of Ethics: I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics

Reviewed Version (pdf): https://openreview.net/references/pdf?id=AWCsobXIex