Few-shot image generation with reverse contrastive learning

Yao Gou, Min Li, Yusen Zhang, Zhuzhen He, Yujie He

Abstract: Generative models, such as Generative Adversarial Networks (GANs), have recently shown remarkable capabilities in various generation tasks. However, the success of these models heavily depends on the availability of a large-scale training dataset. When the size of the training dataset is limited, the quality and diversity of the generated results suffer from severe degradation. In this paper, we propose a novel approach, Reverse Contrastive Learning (RCL), to address the problem of high-quality and diverse image generation under few-shot settings. The success of RCL benefits from a two-sided, powerful regularization. Our proposed regularization is designed based on the correlation between generated samples, which can effectively utilize the latent feature information between different levels of samples. It does not require any auxiliary information or augmentation techniques. A series of qualitative and quantitative results show that our proposed method is superior to the existing State-Of-The-Art (SOTA) methods under the few-shot setting and is still competitive under the low-shot setting, showcasing the effectiveness of RCL. Code will be released upon acceptance at https://github.com/gouayao/RCL.