InfinityGAN: Towards Infinite-Pixel Image SynthesisDownload PDF

29 Sept 2021, 00:30 (modified: 11 Mar 2022, 04:14)ICLR 2022 PosterReaders: Everyone
Keywords: generative modeling, image synthesis, generative adversarial networks, infinite-pixel synthesis, GANs
Abstract: We present InfinityGAN, a method to generate arbitrary-sized images. The problem is associated with several key challenges. First, scaling existing models to an arbitrarily large image size is resource-constrained, both in terms of computation and availability of large-field-of-view training data. InfinityGAN trains and infers patch-by-patch seamlessly with low computational resources. Second, large images should be locally and globally consistent, avoid repetitive patterns, and look realistic. To address these, InfinityGAN takes global appearance, local structure and texture into account. With this formulation, we can generate images with spatial size and level of detail not attainable before. Experimental evaluation supports that InfinityGAN generates images with superior global structure compared to baselines and features parallelizable inference. Finally, we show several applications unlocked by our approach, such as fusing styles spatially, multi-modal outpainting and image inbetweening at arbitrary input and output sizes.
One-sentence Summary: InfinityGAN learns to synthesize arbitrary-sized images with limited resources and enables multiple new applications.
25 Replies