What is mode collapse in GANs and how do you mitigate it?
hardAnswer
- Generator maps most latents to a few output modes because those fool the discriminator well — trained distribution becomes much less diverse than the data.
- Symptoms: repeated outputs, poor coverage of the true distribution.
- Fixes: minibatch discrimination (D sees a batch and can penalize identical outputs), unrolled GAN (train D a few extra steps), WGAN-GP loss for smoother gradients, spectral norm on D, feature matching, or diffusion models (which don't suffer from mode collapse).
Check yourself — multiple choice
- Discriminator failure only
- Generator produces few outputs to fool D → poor diversity; fixes: minibatch discrimination, WGAN-GP, spectral norm, feature matching
- Same as overfitting
- Solved by more epochs
Mode collapse: G outputs limited modes; fixes involve richer signals or better losses (WGAN-GP).
#gan#generative
Practise Deep Learning
214 interview questions in this topic.
Related questions
- Write the vanilla GAN's minimax objective.
- What does WGAN + gradient penalty change vs vanilla GAN?
- What are the main ideas of StyleGAN?
- What is InstanceNorm and where does it shine?
- What is a transposed convolution ('deconv') and its checkerboard artifact issue?
- What is the standard reconstruction loss for autoencoders?