GPSwap: High‐resolution face swapping based on StyleGAN prior

• Published in: Computer animation and virtual worlds Vol. 35; no. 4
• Main Authors: Huang, Dongjin, Liu, Chuanman, Liu, Jinhua
• Format: Journal Article
• Language: English
• Published: Chichester Wiley Subscription Services, Inc 01.07.2024
• Subjects: Consistency; face swapping; high resolution; Image quality; Image reconstruction; Image resolution; StyleGAN prior; training costs
• ISSN: 1546-4261; 1546-427X
• DOI: 10.1002/cav.2238

Existing high‐resolution face‐swapping works are still challenges in preserving identity consistency while maintaining high visual quality. We present a novel high‐resolution face‐swapping method GPSwap, which is based on StyleGAN prior. To better preserves identity consistency, the proposed facial feature recombination network fully leverages the properties of both w space and encoders to decouple identities. Furthermore, we presents the image reconstruction module aligns and blends images in FS space, which further supplements facial details and achieves natural blending. It not only improves image resolution but also optimizes visual quality. Extensive experiments and user studies demonstrate that GPSwap is superior to state‐of‐the‐art high‐resolution face‐swapping methods in terms of image quality and identity consistency. In addition, GPSwap saves nearly 80% of training costs compared to other high‐resolution face‐swapping works. We present a novel high‐resolution face‐swapping method GPSwap, which is based on StyleGAN prior. Extensive experiments demonstrate that GPSwap is superior to other high‐resolution face‐swapping methods in terms of image quality and identity consistency. In addition, GPSwap saves nearly 80% of training costs.