Head Posture Estimation by Deep Learning Using 3-D Point Cloud Data From a Depth Sensor

• Published in: IEEE sensors letters Vol. 5; no. 7; pp. 1 - 4
• Main Authors: Sasaki, Seiji, Premachandra, Chinthaka
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.07.2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: 3-D point cloud data; Cameras; Deep learning; depth sensor; Estimation; Head; head pose estimation; Image acquisition; Magnetic heads; Monkeys & apes; Nose; Sensor signal processing; Sensors; Three dimensional models; Three-dimensional displays
• ISSN: 2475-1472; 2475-1472
• DOI: 10.1109/LSENS.2021.3091640

Head posture estimation is performed by capturing characteristic areas of the face, such as the eyes and nose, in images acquired from a camera installed in front of the subject. However, with this method, parts of the eyes and nose are hidden when the subject turns away and faces the side, making estimation difficult. In this letter, we aim to realize a more effective head estimation method than previous research using 3-D point cloud data from a depth sensor. We pursued the estimation of five head posture classes. In the proposed method, first, the 3-D point cloud data of the postures in the five classes are learned by a deep learning model. Next, the posture of the head is estimated using the model. In this letter, many verification experiments confirmed that the proposed method is very effective for head posture estimation with five posture classes.