PAC-Bayesian Theory

David McAllester, Takintayo Akinbiyi

Abstract: The PAC-Bayesian framework is a frequentist approach to machine learning which encodes learner bias as a “prior probability” over hypotheses. This chapter reviews basic PAC-Bayesian theory, including...