Mental fatigue level detection based on event related and visual evoked potentials features fusion in virtual indoor environment

• Published in: Cognitive neurodynamics Vol. 13; no. 3; pp. 271 - 285
• Main Authors: Lamti, Hachem A., Ben Khelifa, Mohamed Moncef, Hugel, Vincent
• Format: Journal Article
• Language: English
• Published: Dordrecht Springer Netherlands 01.06.2019; Springer Verlag
• Subjects: Artificial Intelligence; Automatic; Biochemistry; Biomedical and Life Sciences; Biomedicine; Cognitive Psychology; Cognitive science; Computer Science; Engineering Sciences; Neuroscience; Neurosciences; Research Article; BCI; SSVEP; Mental fatigue; P300; Evidential reasoning
• ISSN: 1871-4080; 1871-4099
• DOI: 10.1007/s11571-019-09523-2

The purpose of this work is to set up a model that can estimate the mental fatigue of users based on the fusion of relevant features extracted from Positive 300 (P300) and steady state visual evoked potentials (SSVEP) measured by electroencephalogram. To this end, an experimental protocol describes the induction of P300, SSVEP and mental workload (which leads to mental fatigue by varying time-on-task) in different scenarios where environmental artifacts are controlled (obstacles number, obstacles velocities, ambient luminosity). Ten subjects took part in the experiment (with two suffering from cerebral palsy). Their mission is to navigate along a corridor from a starting point A to a goal point B where specific flickering stimuli are introduced to perform the P300 task. On the other hand, SSVEP task is elicited thanks to 10 Hz flickering lights. Correlated features are considered as inputs to fusion block which estimates mental workload. In order to deal with uncertainties and heterogeneity of P300 and SSVEP features, Dempster–Shafer (D–S) evidential reasoning is introduced. As the goal is to assess the reliability for the estimation of mental fatigue levels, D–S is compared to multi layer perception and linear discriminant analysis. The results show that D–S globally outperforms the other classifiers (although its performance significantly decreases between healthy and palsied groups). Finally we discuss the feasibility of such a fusion proposal in real life situation.