Evolution of Discriminator and Generator Gradients in GAN Training: From Fitting to Collapse
Abstract: Generative Adversarial Networks (GANs) are powerful generative models but often suffer from mode mixture and mode collapse. We propose a perspective that views GAN training as a two-phase progression from fitting to collapse, where mode mixture and mode collapse are treated as inter-connected. Inspired by the particle model interpretation of GANs, we leverage the discriminator gradient to analyze particle movement and the generator gradient, specifically "steepness," to quantify the severity of mode mixture by measuring the generator's sensitivity to changes in the latent space. Using these theoretical insights into evolution of gradients, we design a specialized metric that integrates both gradients to detect the transition from fitting to collapse. This metric forms the basis of an early stopping algorithm, which stops training at a point that retains sample quality and diversity. Experiments on synthetic and real-world datasets, including MNIST, Fashion MNIST, and CIFAR-10, validate our theoretical findings and demonstrate the effectiveness of the proposed algorithm.
Submission Length: Long submission (more than 12 pages of main content)
Previous TMLR Submission Url: https://openreview.net/forum?id=MWam9EhQYS
Changes Since Last Submission: - Referenced the related work section when introducing the definition of steepness (Section 2.3, p. 4).
- Expanded the discussion on the hypothesis of the gradient-flow limit in Theorem 3.3, highlighting the corresponding requirement for the generator (Section 3.2, p. 8).
- Clarified how Tanielian et al. (2020) rely on local steepness for their rejection method and emphasized how our local approach provides a complementary perspective (Section 5, p. 13).
- Increased font sizes in figures (Figures 5–6, 17–19).
- Numbered all equations.
- Included codes in the supplementary material.
- Fixed some typos.
Supplementary Material: zip
Assigned Action Editor: ~Fernando_Perez-Cruz1
Submission Number: 3757
Loading