Real-time classification of evoked emotions using facial feature tracking and physiological responses

• Published in: International journal of human-computer studies Vol. 66; no. 5; pp. 303 - 317
• Main Authors: Bailenson, Jeremy N., Pontikakis, Emmanuel D., Mauss, Iris B., Gross, James J., Jabon, Maria E., Hutcherson, Cendri A.C., Nass, Clifford, John, Oliver
• Format: Journal Article
• Language: English
• Published: London Elsevier Ltd 01.05.2008; Elsevier
• Subjects: Affective computing; Applied sciences; Artificial intelligence; Computer science; control theory; systems; Computer systems and distributed systems. User interface; Computer vision; Emotion; Exact sciences and technology; Facial tracking; Pattern recognition. Digital image processing. Computational geometry; Software; Affective computing; Computer vision; Emotion; Facial tracking; Tracking; Sex; Video signal; Emotion emotionality; Sympathetic skin response; Real time; Modeling; Model matching; User interface; Classification; Learning algorithm; Artificial intelligence

We present automated, real-time models built with machine learning algorithms which use videotapes of subjects’ faces in conjunction with physiological measurements to predict rated emotion (trained coders’ second-by-second assessments of sadness or amusement). Input consisted of videotapes of 41 su...