Diverse videos synthesis using manifold-based parametric motion model for facial understanding

• Published in: IET image processing Vol. 10; no. 4; pp. 253 - 260
• Main Authors: Mohammadian, Amin, Aghaeinia, Hassan, Towhidkhah, Farzad
• Format: Journal Article
• Language: English
• Published: The Institution of Engineering and Technology 01.04.2016
• Subjects: Accuracy; baseline model; diverse video synthesis; Enrichment; Face recognition; Facial; facial expression recognition; facial understanding; feature extraction; image motion analysis; Image processing; image representation; lower‐dimensional feature space; manifold‐based parametric motion model; Mathematical analysis; Object recognition; personal style; source person trajectory; Vectors (mathematics); video signal processing; virtual sample diverse sequence generation; virtual vector; baseline model; virtual vector; image motion analysis; manifold-based parametric motion model; virtual sample diverse sequence generation; feature extraction; image representation; diverse video synthesis; face recognition; source person trajectory; personal style; lower-dimensional feature space; video signal processing; facial understanding; facial expression recognition
• ISSN: 1751-9659; 1751-9667
• DOI: 10.1049/iet-ipr.2014.0905

Personal style is the cause of interpersonal variations, which play an important role in facial expression recognition. In this study, a model has been proposed to generate diverse sequences of virtual samples for a new subject. These sequences are thought to enrich the training set in order to increase robustness of recognition with respect to individual variations and improve generalisation to the new person. In the manifold-based parametric motion model, the trajectory of the source person has been used to estimate and conduct the virtual facial expression vectors of the target person. In the recognition experiments, images are represented in the lower-dimensional feature space, whereas the virtual vectors are generated in the feature space. The accuracy of the independent system shows the effectiveness of samples in improving the performance of the system based on the limited data of the new person. The accuracy of seven expressions is 90.65%, which is an improvement over the baseline model, which is 86.11%, and represents a significant (P < 0.05) improvement over the baseline method, which is 83.4%.