An EEG based familiar and unfamiliar person identification and classification system using feature extraction and directed functional brain network

• Published in: Expert systems with applications Vol. 158; p. 113448
• Main Authors: Chang, Wenwen, Wang, Hong, Yan, Guanghui, Liu, Chong
• Format: Journal Article
• Language: English
• Published: New York Elsevier Ltd 15.11.2020; Elsevier BV
• Subjects: Auditory stimuli; Brain; Brain signal complexity; Classification; Classifiers; Data analysis; Directed functional connectivity; Electroencephalogram (EEG); Familiar/unfamiliar person recognition; Feature extraction; Frequency analysis; Network analysis; Pattern recognition; Pattern recognition systems; Visual stimuli; Feature extraction; Familiar/unfamiliar person recognition; Electroencephalogram (EEG); Directed functional connectivity; Classification; Brain signal complexity
• ISSN: 0957-4174; 1873-6793
• DOI: 10.1016/j.eswa.2020.113448

•Proposes an multi-channel EEG based approach for person recognition.•Directed functional network is analyzed to identify familiar from unfamiliar person.•Several EEG signal complexities are analyzed in person recognition.•Network parameters combined with complexities form the feature set for classification.•Delta wave is the best frequency band for person recognition. People are extremely proficient at recognizing familiar person, but are much worse at matching unfamiliar one. However, the neural correlation of this proposed difference in neural representations of familiar and unfamiliar identities remains unclear. New methods of EEG data analysis, functional networks and time frequency analyses, are highly recommended to advance the knowledge of those brain mechanisms. Developing an EEG based pattern recognition system could potentially be used to improve the current person recognition strategies. In this study, we designed a multi-channel EEG based pattern recognition system for person recognition. To do this, a new feature extraction method combining directed functional network analysis and signal complexity of EEGs from different brain regions was proposed, which is the main contribution of this paper. The proposed method was tested in an experiment of 20 subjects underlying visual and auditory stimuli simultaneously. The features were calculated in delta, theta, alpha and beta band respectively, then SVM and KNN classifiers were applied to these feature sets and the results showed the recognition accuracies of these four bands are relatively stable with the best accuracy of 90.58% in delta band for SVM. In addition, theta and alpha band also showed good performance for the two classifiers. It indicated delta wave is the best sub band for person perception and SVM is better than KNN in this system. This work is the first time to construct the directed functional network in person recognition study, and it demonstrated the combination of non-linear complexities and network features are efficient for EEG based expert and intelligent system for person recognition.