Affective Video Classification Based on Spatio-temporal Feature Fusion

In this paper, we propose a novel affective video classification method based on facial expression recognition by learning the spatio-temporal feature fusion of actors' and viewers' facial expressions. For spatial features, we integrate Haar-like features into compositional ones according...

Full description

Saved in:
Bibliographic Details
Published in2011 Sixth International Conference on Image and Graphics pp. 795 - 800
Main Authors Sicheng Zhao, Hongxun Yao, Xiaoshuai Sun
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.08.2011
Subjects
Accuracy
affective video clssification
Classification algorithms
Face recognition
facial expression recognition
Feature extraction
hidden dynamic conditional random fields
Motion pictures
spatio-temporal feature fusion
Training
Online AccessGet full text

Cover

More Information
Summary:In this paper, we propose a novel affective video classification method based on facial expression recognition by learning the spatio-temporal feature fusion of actors' and viewers' facial expressions. For spatial features, we integrate Haar-like features into compositional ones according to the features' correlation, and train a mid classifier during the period. Then this process is embedded into improved AdaBoost learning algorithm to obtain spatial features. And for temporal feature fusion, we adopt hidden dynamic conditional random fields (HDCRFs) based on HCRFs by introducing time dimension variable. Finally spatial features are embedded into HDCRFs to recognize facial expressions. Experiments on the well-known Cohn-Kanada database show that the proposed method has a promising recognition performance. And affective classification experimental results on our own videos show that most subjects are satisfied with the classification results.
ISBN:1457715600
9781457715600
DOI:10.1109/ICIG.2011.181