Shortest Program Interpolation Learning

Naren Sarayu Manoj, Nathan Srebro

Abstract: We prove that the Minimum Program Length learning rule exhibits tempered overfitting. We obtain tempered agnostic finite sample learning guarantees and characterize the asymptotic behavior in the presence of random label noise.