Localized Meta-Learning: A PAC-Bayes Analysis for Meta-Leanring Beyond Global Prior

Sep 25, 2019 Blind Submission readers: everyone Show Bibtex
  • Abstract: Meta-learning methods learn the meta-knowledge among various training tasks and aim to promote the learning of new tasks under the task similarity assumption. However, such meta-knowledge is often represented as a fixed distribution, which is too restrictive to capture various specific task information. In this work, we present a localized meta-learning framework based on PAC-Bayes theory. In particular, we propose a LCC-based prior predictor that allows the meta learner adaptively generate local meta-knowledge for specific task. We further develop a pratical algorithm with deep neural network based on the bound. Empirical results on real-world datasets demonstrate the efficacy of the proposed method.
  • Keywords: localized meta-learning, PAC-Bayes, meta-learning
  • Original Pdf:  pdf
0 Replies