Method for driving interactive object and processing phoneme, device and storage medium

Disclosed are a method for driving interactive object and processing phoneme, a device and a storage medium. The method for driving interactive object includes: obtaining sound features of sound driving data for the interactive object; performing feature extraction for the sound features by a sound...

Full description

Saved in:
Bibliographic Details
Main Authors WU, QIAN-YI, WU, WEN-YAN, QIAN, CHEN, GAO, NA
Format Patent
LanguageChinese
English
Published 16.12.2022
Subjects
ACOUSTICS
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
MUSICAL INSTRUMENTS
PHYSICS
SPEECH ANALYSIS OR SYNTHESIS
SPEECH OR AUDIO CODING OR DECODING
SPEECH OR VOICE PROCESSING
SPEECH RECOGNITION
Online AccessGet full text

Cover

More Information
Summary:Disclosed are a method for driving interactive object and processing phoneme, a device and a storage medium. The method for driving interactive object includes: obtaining sound features of sound driving data for the interactive object; performing feature extraction for the sound features by a sound feature extraction network to obtain phoneme posterior probability of each voice frame in the sound driving data; wherein the sound feature extraction network is obtained by training a phoneme table including multiple languages; obtaining movement parameter values for the interactive object according to the phoneme posterior probability of each voice frame; controlling movements of the interactive object according to the posture parameter values.
Bibliography:Application Number: TW202211119388