PAC-Bayes Few-shot Meta-learning with Implicit Learning of Model Prior Distribution

Sep 25, 2019 ICLR 2020 Conference Withdrawn Submission readers: everyone
  • Keywords: meta-learning, few-shot learning
  • TL;DR: Bayesian meta-learning using PAC-Bayes framework and implicit prior distributions
  • Abstract: We introduce a new and rigorously-formulated PAC-Bayes few-shot meta-learning algorithm that implicitly learns a model prior distribution of interest. Our proposed method extends the PAC-Bayes framework from a single task setting to the few-shot meta-learning setting to upper-bound generalisation errors on unseen tasks. We also propose a generative-based approach to model the shared prior and task-specific posterior more expressively compared to the usual diagonal Gaussian assumption. We show that the models trained with our proposed meta-learning algorithm are well calibrated and accurate, with state-of-the-art calibration and classification results on mini-ImageNet benchmark, and competitive results in a multi-modal task-distribution regression.
  • Code: https://www.dropbox.com/s/fa0msqrr74psaej/SImBa_code.zip?dl=0
0 Replies

Loading