Human Emotions Classification Using EEG via Audiovisual Stimuli and AI

• Published in: Computers, materials & continua Vol. 73; no. 3; pp. 5075 - 5089
• Main Authors: A Asiri, Abdullah, Badshah, Akhtar, Muhammad, Fazal, A Alshamrani, Hassan, Ullah, Khalil, A Alshamrani, Khalaf, Alqhtani, Samar, Irfan, Muhammad, Talal Halawani, Hanan, M Mehdar, Khlood
• Format: Journal Article
• Language: English
• Published: Henderson Tech Science Press 2022
• Subjects: Algorithms; Bandpass filters; Brain; Classification; Electroencephalography; Emotions; Feature extraction; Medical imaging; Multilayer perceptrons; Signal processing; Stimuli
• ISSN: 1546-2226; 1546-2218; 1546-2226
• DOI: 10.32604/cmc.2022.031156

Electroencephalogram (EEG) is a medical imaging technology that can measure the electrical activity of the scalp produced by the brain, measured and recorded chronologically the surface of the scalp from the brain. The recorded signals from the brain are rich with useful information. The inference of this useful information is a challenging task. This paper aims to process the EEG signals for the recognition of human emotions specifically happiness, anger, fear, sadness, and surprise in response to audiovisual stimuli. The EEG signals are recorded by placing neurosky mindwave headset on the subject’s scalp, in response to audiovisual stimuli for the mentioned emotions. Using a bandpass filter with a bandwidth of 1–100 Hz, recorded raw EEG signals are preprocessed. The preprocessed signals then further analyzed and twelve selected features in different domains are extracted. The Random forest (RF) and multilayer perceptron (MLP) algorithms are then used for the classification of the emotions through extracted features. The proposed audiovisual stimuli based EEG emotion classification system shows an average classification accuracy of 80% and 88% using MLP and RF classifiers respectively on hybrid features for experimental signals of different subjects. The proposed model outperforms in terms of cost and accuracy.