AVATAR CONSTRUCTION USING DEPTH CAMERA

• Main Authors: MOLYNEAUX DAVID, CHANG ERIC, YANG EMILY, TONG XIN, YANG FAN, LIU YANG, KAPUR JAY, WU HSIANG TAO, LIU ZICHENG
• Format: Patent
• Language: English; Korean
• Published: 09.03.2015
• Subjects: CALCULATING; COMPUTING; COUNTING; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; PHYSICS

A method for constructing an avatar of a human subject includes acquiring a depth map of the subject, obtaining a virtual skeleton of the subject based on the depth map, and harvesting from the virtual skeleton a set of characteristic metrics. Such metrics correspond to distances between predetermined points of the virtual skeleton. In this example method, the characteristic metrics are provided as input to an algorithm trained using machine learning. The algorithm may be trained using a human model in a range of poses, and a range of human models in a single pose, to output a virtual body mesh as a function of the characteristic metrics. The method also includes constructing a virtual head mesh distinct from the virtual body mesh, with facial features resembling those of the subject, and connecting the virtual body mesh to the virtual head mesh.