Hierarchical Few-Shot Generative Models

Giorgio Giannone, Ole Winther

Keywords: Variational Autoencoders, Few-Shot Generation, Hierarchical Inference, Learnable Aggregation.

TL;DR: A generative model based on hierarchical inference and attentive aggregation for few-shot generation.

Abstract: A few-shot generative model should be able to generate data from a distribution by only observing a limited set of examples. In few-shot learning the model is trained on data from many sets from different distributions sharing some underlying properties such as sets of characters from different alphabets or sets of images of different type objects. We study a latent variables approach that extends the Neural Statistician to a fully hierarchical approach with an attention-based point to set-level aggregation. We extend the previous work to iterative data sampling, likelihood-based model comparison, and adaptation-free out of distribution generalization. Our results show that the hierarchical formulation better captures the intrinsic variability within the sets in the small data regime. With this work we generalize deep latent variable approaches to few-shot learning, taking a step towards large-scale few-shot generation with a formulation that readily can work with current state-of-the-art deep generative models.

Contribution Process Agreement: Yes

Poster Session Selection: Poster session #3 (16:50 UTC)

Community Implementations: [ 2 code implementations](https://www.catalyzex.com/paper/arxiv:2110.12279/code)