METHOD AND SYSTEM FOR GENERATING AVATAR BASED ON TEXT

The present disclosure relates to a text-based avatar generation method performed by at least one processor of an information processing system. The avatar generation method includes the steps of: synthesizing the voice of an avatar based on input text; generating a lip sync animation based on meta...

Full description

Saved in:
Bibliographic Details
Main Authors LEE SE YUN, CHOI KIHWAN, KIM DONG GYUN, JEGAL SUMIN, LEE HO JIN, CHOI SUNGJUN, KIM JAE MIN, PARK SO HYUN, KIM SUNTAE, LEE SUMEE, KIM BYOUNGEUL, LEE ZOO HYUN
Format Patent
LanguageEnglish
Korean
Published 31.05.2023
Subjects
ACOUSTICS
CALCULATING
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
COMPUTING
COUNTING
ELECTRIC COMMUNICATION TECHNIQUE
ELECTRICITY
IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
MUSICAL INSTRUMENTS
PHYSICS
PICTORIAL COMMUNICATION, e.g. TELEVISION
SPEECH ANALYSIS OR SYNTHESIS
SPEECH OR AUDIO CODING OR DECODING
SPEECH OR VOICE PROCESSING
SPEECH RECOGNITION
Online AccessGet full text

Cover

More Information
Summary:The present disclosure relates to a text-based avatar generation method performed by at least one processor of an information processing system. The avatar generation method includes the steps of: synthesizing the voice of an avatar based on input text; generating a lip sync animation based on meta information of the synthesized voice; estimating the motion of the avatar based on the input text; and generating a full body animation of the avatar by combining the lip sync animation and the estimated motion. 본 개시는 정보 처리 시스템의 적어도 하나의 프로세서에 의해 수행되는, 텍스트 기반의 아바타 생성 방법에 관한 것이다. 아바타 생성 방법은, 입력 텍스트에 기초하여 아바타의 음성을 합성하는 단계, 합성된 음성의 메타 정보에 기초하여 립 싱크 애니메이션을 생성하는 단계, 입력 텍스트에 기초하여 아바타의 모션을 추정하는 단계, 및 립 싱크 애니메이션 및 추정된 모션을 합성하여 아바타의 전신 애니메이션을 생성하는 단계를 포함한다.
Bibliography:Application Number: KR20210162774