Data processing method and device, equipment, medium and program product

• Main Authors: ZHOU YONGJI, JIANG JINGJING, YU XUEWU, HE WENMING, FAN HUISHAN, ZHANG LINGNA, ZHAO XINYANG, HUANG ZILONG, WANG LIAN
• Format: Patent
• Language: Chinese; English
• Published: 05.09.2023
• Subjects: ACOUSTICS; CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; MUSICAL INSTRUMENTS; PHYSICS; SPEECH ANALYSIS OR SYNTHESIS; SPEECH OR AUDIO CODING OR DECODING; SPEECH OR VOICE PROCESSING; SPEECH RECOGNITION

The invention discloses a data processing method and device, equipment, a medium and a program product, and the method comprises the steps: obtaining a face key point prediction model under the condition of obtaining target audio data, the face key point prediction model at least comprises N first feature extraction networks, a first residual network and a key point prediction network, the first feature extraction network comprises a multi-head attention mechanism; the target audio parameters are input into N first feature extraction networks, N groups of different first target audio features of the target audio parameters are obtained through the N first feature extraction networks, and the target audio parameters are parameters extracted from the target audio data; obtaining a first key audio feature by using a first residual network according to the N groups of first target audio features; and inputting the first key audio features into a key point prediction network, and obtaining face key points through