ANIMATED REPRESENTATION OF FACIAL EXPRESSION

• Main Authors: BARLIER, Guillaume P, SOMMER, Bruno M, PHAM, Hoan, STOYLES, Justin D, MOHA, Alexandre R, DAMASKY, Nina, GOOSSENS, Thomas, AMBERG, Brian, GUZMAN, Aurelio, SCAPEL, Nicolas V, WEISE, Thibaut
• Format: Patent
• Language: English
• Published: 15.08.2019
• Subjects: CALCULATING; COMPUTING; COUNTING; ELECTRIC COMMUNICATION TECHNIQUE; ELECTRICITY; HANDLING RECORD CARRIERS; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; INFORMATION STORAGE; INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORDCARRIER AND TRANSDUCER; PHYSICS; PICTORIAL COMMUNICATION, e.g. TELEVISION; PRESENTATION OF DATA; RECOGNITION OF DATA; RECORD CARRIERS

Systems and methods for generating a video of an emoji that has been puppeted using inputs from image, depth, and audio. The inputs can capture facial expressions of a user, eye, eyebrow, mouth, and head movements. A pose, held by the user, can be detected that can be used to generate supplemental animation. The emoji can further be animated using physical properties associated with the emoji and captured movements. An emoji of a dog can have its ears move in response to an up-and-down movement, or a shaking of the head. The video can be sent in a message to one or more recipients. A sending device can render the puppeted video in accordance with hardware and software capabilities of a recipient's computer device.