Real-time support vector classification and feedback of multiple emotional brain states

• Published in: NeuroImage (Orlando, Fla.) Vol. 56; no. 2; pp. 753 - 765
• Main Authors: Sitaram, Ranganatha, Lee, Sangkyun, Ruiz, Sergio, Rana, Mohit, Veit, Ralf, Birbaumer, Niels
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 15.05.2011; Elsevier Limited
• Subjects: Adult; Artificial Intelligence; Brain - physiology; Brain mapping; Brain Mapping - methods; Brain research; Classification; Discriminant analysis; Emotions; Emotions - physiology; Feces; Feedback; Humans; Image Processing, Computer-Assisted - methods; Magnetic Resonance Imaging; Neurosciences; NMR; Nuclear magnetic resonance; Studies; Young Adult
• ISSN: 1053-8119; 1095-9572; 1095-9572
• DOI: 10.1016/j.neuroimage.2010.08.007

An important question that confronts current research in affective neuroscience as well as in the treatment of emotional disorders is whether it is possible to determine the emotional state of a person based on the measurement of brain activity alone. Here, we first show that an online support vector machine (SVM) can be built to recognize two discrete emotional states, such as happiness and disgust from fMRI signals, in healthy individuals instructed to recall emotionally salient episodes from their lives. We report the first application of real-time head motion correction, spatial smoothing and feature selection based on a new method called Effect mapping. The classifier also showed robust prediction rates in decoding three discrete emotional states (happiness, disgust and sadness) in an extended group of participants. Subjective reports ascertained that participants performed emotion imagery and that the online classifier decoded emotions and not arbitrary states of the brain. Offline whole brain classification as well as region-of-interest classification in 24 brain areas previously implicated in emotion processing revealed that the frontal cortex was critically involved in emotion induction by imagery. We also demonstrate an fMRI-BCI based on real-time classification of BOLD signals from multiple brain regions, for each repetition time (TR) of scanning, providing visual feedback of emotional states to the participant for potential applications in the clinical treatment of dysfunctional affect. ►first application of real-time head motion correction, spatial smoothing and feature selection based on a new method called Effect mapping. ►robust prediction by real-time classifier in decoding three discrete emotional states (happiness, disgust and sadness) ►frontal cortex is critically involved in emotion induction by imagery. ►demonstration of real-time feedback of emotional states and self-regulation learning.