GSFaceMorpher: High‐Fidelity 3D Face Morphing via Gaussian Splatting

• Published in: Computer animation and virtual worlds Vol. 36; no. 3
• Main Authors: Shi, Xiwen, Zhao, Hao, Jiang, Yi, Xu, Hao, Yang, Ziyi, Wu, Yiqian, Wu, Qingbiao, Jin, Xiaogang
• Format: Journal Article
• Language: English
• Published: Hoboken, USA John Wiley & Sons, Inc 01.05.2025; Wiley Subscription Services, Inc
• Subjects: 3D gaussian splatting; Animation; computer animation; diffusion model; face morphing; Morphing; Radial basis function; Visual effects
• ISSN: 1546-4261; 1546-427X
• DOI: 10.1002/cav.70036

ABSTRACT High‐fidelity 3D face morphing aims to achieve seamless transitions between realistic 3D facial representations of different identities. Although 3D Gaussian Splatting (3DGS) excels in high‐quality rendering, its application to morphing is hindered by the lack of Gaussian primitive correspondence and variations in primitive quantities. To address this, we propose GSFaceMorpher, which is a novel framework for high‐fidelity 3D face morphing based on 3DGS. Our method constructs an auxiliary model that bridges the source and target face models by aligning the geometry through Radial Basis Function (RBF) warping and optimizing the appearance in the image space. This auxiliary model enables smooth parameter interpolation, whereas a diffusion‐based refinement step enhances critical facial details through attention replacement from the reference faces. Experiments demonstrate that our method produces visually coherent and high‐fidelity morphing sequences, significantly outperforming NeRF‐based baselines in terms of both quantitative metrics and user preferences. Our work establishes a new benchmark for high‐fidelity 3D face morphing with applications in visual effects, animation, and immersive experiences. Given two pre‐trained 3D Gaussian Splatting (3DGS) face models, our method enables smooth and high‐fidelity morphing between the source and target identities.