In this section, we will provide an extensive list of tricks compiled from the GAN research community, from Soumith Chintala in particular. The following list can help with the notably hard task of training GANs. Compared to MLE approaches that have been implemented and evaluated for decades, and are also much simpler to train, the GAN framework is only a few years old. There are many developments that been made, therefore, that improve the evaluation and training procedure.
Tricks of the trade
Tracking failure
It is important to track failure early on to speed up the training process.
Loss of the discriminator goes to 0.
When the loss of the discriminator goes to 0, as mentioned, the updates of the generator are insignificant...
