FAEC‐GAN: An unsupervised face‐to‐anime translation based on edge enhancement and coordinate attention

• Published in: Computer animation and virtual worlds Vol. 34; no. 6
• Main Authors: Lin, Hong, Xu, Chenchen, Liu, Chun
• Format: Journal Article
• Language: English
• Published: Hoboken, USA John Wiley & Sons, Inc 01.11.2023; Wiley Subscription Services, Inc
• Subjects: Animation; Anime; computer vision; deep learning; generative adversarial networks; Image enhancement; Pixels; Visual effects
• ISSN: 1546-4261; 1546-427X
• DOI: 10.1002/cav.2135

Animation is a widely loved artistic form with high ion and powerful expression. The task of image translation from face to anime involves complex geometric and texture transformations, and requires the generated images with clear lines. The existing unsupervised image translation frameworks are often ineffective for this task. According to the characteristics of animation image, we propose an animation translation method based on edge enhancement and coordinate attention, which is called FAEC‐GAN. We design a novel edge discrimination network to identify the edge features of images, so that the generated anime images can present clear and coherent lines. And the coordinate attention module is introduced in the encoder to adapt the model to the geometric changes in translation, so as to produce more realistic animation images. In addition, our method combines the focal frequency loss and pixel loss, which can pay attention to both the frequency domain information and pixel information of the generated image to improve the visual effect of the image. The experimental results demonstrate that FAEC‐GAN is superior to the state‐of‐the‐art methods in the task of face‐to‐animation image translation. FAEC‐GAN is an animation translation method based on edge enhancement and coordinate attention. We propose an edge discrimination network to identify the edge features of images, which makes images have coherent lines. And the coordinate attention module is introduced in the encoder to adapt the model to the geometric changes in translation.