Generation of Comic Style Chernoff Face with GAN

• Published in: Journal of Advanced Computational Intelligence and Intelligent Informatics Vol. 29; no. 2; pp. 396 - 406
• Main Authors: Chen, Yen-Chia, Shibata, Hiroki, Takama, Yasufumi
• Format: Journal Article
• Language: English
• Published: Tokyo Fuji Technology Press Ltd 20.03.2025; 富士技術出版株式会社; Fuji Technology Press Co. Ltd
• Subjects: Anime; Chernoff face; Comics; Direct conversion; generative adversarial network; Generative adversarial networks; Graphs; information visualization; Machine learning; Multidimensional data; Questionnaires; Visualization
• ISSN: 1343-0130; 1883-8014
• DOI: 10.20965/jaciii.2025.p0396

This paper proposes a method for generating comic style Chernoff face with generative adversarial network (GAN) as a first step towards the generation of data comics from multi-dimensional data. The proposed method converts Chernoff face into comic style face images based on the combination of CycleGAN and Pix2Pix. Since both Chernoff face graph and comic images do not have enough information for direct conversion, the Chernoff face graphs are converted into photo style face images and then converted into comic images. A questionnaire asking to rank face images according to the specified impressions is conducted to evaluate the proposed method. The result of the questionnaire shows that the proposed method achieved the same level of consistency among answerers’ judgments as original Chernoff face. It is also confirmed that the proposed method can express the difference in attribute values with mouth parts.