Conditional Activation GAN: Improved Auxiliary Classifier GAN

• Published in: IEEE access Vol. 8; pp. 216729 - 216740
• Main Authors: Cho, Jeongik, Yoon, Kyoungro
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2020; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Artificial neural networks; auxiliary classifier GAN; batch normalization; Classifiers; conditional GAN; deep learning; Entropy; Gallium nitride; Generative adversarial networks; Generators; loss function; Probability distribution; Training
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2020.3041480

A conditional generative adversarial network (cGAN) is a generative adversarial network (GAN) that generates data with a desired condition from a latent vector. Among the different types of cGAN, the auxiliary classifier GAN (ACGAN) is the most frequently used. In this study, we describe the problems of an AC-GAN and propose replacing it with a conditional activation GAN (CAGAN) to reduce the number of hyperparameters and improve the training speed. The loss function of a CAGAN is defined as the sum of the loss of each GAN created for each condition. The proposed CAGAN is an integration of multiple GANs, where each GAN shares all hidden layers, and their integration can be considered as a single GAN. Therefore, the structure of the integrated GANs does not significantly increase the number of computations. Additionally, to prevent the conditions given in the discriminator of a cGAN from being ignored with batch normalization, we propose mixed batch training, in which every batch for the discriminator keeps the ratio of the real and generated data consistent.