Image generation method, apparatus, device, and storage medium

The present disclosure provides an image generation method, an apparatus, a device, and a storage medium. The method may include: receiving audio data and a face image; and extracting text features corresponding to an audio sequence included in the audio data. The text features represent text conten...

Full description

Saved in:
Bibliographic Details
Main Authors WU, QIAN-YI, WU, WEN-YAN, QIAN, CHEN, GAO, NA, WANG, YU-XIN, DAI, BO
Format Patent
LanguageChinese
English
Published 01.12.2022
Subjects
ACOUSTICS
MUSICAL INSTRUMENTS
PHYSICS
SPEECH ANALYSIS OR SYNTHESIS
SPEECH OR AUDIO CODING OR DECODING
SPEECH OR VOICE PROCESSING
SPEECH RECOGNITION
Online AccessGet full text

Cover

More Information
Summary:The present disclosure provides an image generation method, an apparatus, a device, and a storage medium. The method may include: receiving audio data and a face image; and extracting text features corresponding to an audio sequence included in the audio data. The text features represent text content of the audio sequence. Based on the text features corresponding to the audio sequence, facial feature mapping is performed to obtain facial features corresponding to the audio sequence. The facial features represent pronunciation movements corresponding to the audio sequence. According to the facial features and the face image corresponding to the audio sequence, a pronounceable face image corresponding to the audio sequence is generated.
Bibliography:Application Number: TW202211115986