Spatiotemporal-Boosted DCT Features for Head and Face Gesture Analysis

• Published in: Human Behavior Understanding pp. 64 - 74
• Main Authors: Çınar Akakın, Hatice, Sankur, Bülent
• Format: Book Chapter
• Language: English
• Published: Berlin, Heidelberg Springer Berlin Heidelberg 2010
• Series: Lecture Notes in Computer Science
• Subjects: Adaboost Algorithm; Facial Expression; Facial Expression Recognition; Facial Landmark; Image Patch
• ISBN: 3642147143; 9783642147142
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-642-14715-9_7

Automatic analysis of head gestures and facial expressions is a challenging research area and it has significant applications in human-computer interfaces. In this study, facial landmark points are detected and tracked over successive video frames using a robust method based on subspace regularization, Kalman prediction and refinement. The trajectories (time series) of facial landmark positions during the course of the head gesture or facial expression are organized in a spatiotemporal matrix and discriminative features are extracted from the trajectory matrix. Alternatively, appearance based features are extracted from DCT coefficients of several face patches. Finally Adaboost algorithm is performed to learn a set of discriminating spatiotemporal DCT features for face and head gesture (FHG) classification. We report the classification results obtained by using the Support Vector Machines (SVM) on the outputs of the features learned by Adaboost. We achieve 94.04% subject independent classification performance over seven FHG.