Few-shot Adaptation of Generative Adversarial Networks

Esther Robb, Wen-Sheng Chu, Abhishek Kumar, Jia-Bin Huang

Keywords: GAN, Few-shot, SVD, PCA

Abstract: This paper proposes a simple and effective method, Few-Shot GAN (FSGAN), for adapting GANs in few-shot settings (less than 100 images). FSGAN repurposes component analysis techniques, learning to adapt the singular values of the pre-trained weights while freezing the corresponding singular vectors. This provides a highly expressive parameter space for adaptation while constraining changes to the pretrained weights. We validate our method in a challenging few-shot setting of 5-100 images in the target domain. We show that our method has significant visual quality gains compared with existing GAN adapation methods. We report extensive qualitative and quantitative results showing the effectiveness of our method. We additionally highlight a problem for few-shot synthesis in the standard quantitative metric used by data-efficient image synthesis works.

Code Of Ethics: I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics

One-sentence Summary: Few-shot GAN adaptation using SVD.

Community Implementations: [ 3 code implementations](https://www.catalyzex.com/paper/arxiv:2010.11943/code)

Reviewed Version (pdf): https://openreview.net/references/pdf?id=0E85ZPYdQU