Mind reading machines: automated inference of cognitive mental states from video

Mind reading encompasses our ability to attribute mental states to others, and is essential for operating in a complex social environment. The goal in building mind reading machines is to enable computer technologies to understand and react to people's emotions and mental states. This paper des...

Full description

Saved in:
Bibliographic Details
Published in2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583) Vol. 1; pp. 682 - 688 vol.1
Main Authors El Kaliouby, R., Robinson, P.
Format Conference Proceeding
LanguageEnglish
Published Piscataway NJ IEEE 2004
Subjects
Applied sciences
Artificial intelligence
Autism
Bayesian methods
Computer displays
Computer networks
Computer science; control theory; systems
Computer systems and distributed systems. User interface
Control theory. Systems
Exact sciences and technology
Face recognition
Human computer interaction
Inhibitors
Magnetic heads
Pattern recognition. Digital image processing. Computational geometry
Prototypes
Real time systems
Software
Head
Man machine system
Video signal
Video technique
Inference
Emotion emotionality
Classifier
Distributed system
Real time
Video recording
Mental model
Cognitive theory
User interface
Sociology
Classification
Facies
Gesture
Bayes network
Automatic recognition
Reading device
Facial expression
Online AccessGet full text

Cover

More Information
Summary:Mind reading encompasses our ability to attribute mental states to others, and is essential for operating in a complex social environment. The goal in building mind reading machines is to enable computer technologies to understand and react to people's emotions and mental states. This paper describes a system, for the automated inference of cognitive mental states from observed facial expressions and head gestures in video. The system is based on a multilevel dynamic Bayesian network classifier which models cognitive mental states as a number of interacting facial and head displays. Experimental results yield an average recognition rate of 87.4% for 6 mental states groups: agreement, concentrating, disagreement, interested, thinking and unsure. Real time performance, unobtrusiveness and lack of preprocessing make our system particularly suitable for user-independent human computer interaction
ISBN:0780385667
9780780385665
ISSN:1062-922X
2577-1655
DOI:10.1109/ICSMC.2004.1398380