Learning across multi-stimulus enhances target recognition methods in SSVEP-based BCIs

• Published in: Journal of neural engineering Vol. 17; no. 1; pp. 16026 - 16043
• Main Authors: Wong, Chi Man, Wan, Feng, Wang, Boyu, Wang, Ze, Nan, Wenya, Lao, Ka Fai, Mak, Peng Un, Vai, Mang I, Rosa, Agostinho
• Format: Journal Article
• Language: English
• Published: England IOP Publishing 06.01.2020
• Subjects: brain-computer interface; Brain-Computer Interfaces; canonical correlation analysis; Evoked Potentials, Visual - physiology; Humans; Learning - physiology; learning across multi-stimulus; Recognition, Psychology - physiology; Signal Processing, Computer-Assisted; steady-state visual evoked potential; task-related component analysis
• ISSN: 1741-2560; 1741-2552; 1741-2552
• DOI: 10.1088/1741-2552/ab2373

Objective. Latest target recognition methods that are equipped with learning from the subject's calibration data, represented by the extended canonical correlation analysis (eCCA) and the ensemble task-related component analysis (eTRCA), can achieve extra high performance in the steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs), however their performance deteriorate drastically if the calibration trials are insufficient. This paper develops a new scheme to learn from limited calibration data. Approach. A learning across multiple stimuli scheme is proposed for the target recognition methods, which applies to learning the data corresponding to not only the target stimulus but also the other stimuli. The resulting optimization problems can be simplified and solved utilizing the prior knowledge and properties of SSVEPs across different stimuli. With the new learning scheme, the eCCA and the eTRCA can be extended to the multi-stimulus eCCA (ms-eCCA) and the multi-stimulus eTRCA (ms-eTRCA), respectively, as well as a combination of them (i.e. ms-eCCA+ms-eTRCA) that incorporates their merits. Main results. Evaluation and comparison using an SSVEP-BCI benchmark dataset with 35 subjects show that the ms-eCCA (or ms-eTRCA) performs significantly better than the eCCA (or eTRCA) method while the ms-eCCA+ms-eTRCA performs the best. With the learning across stimuli scheme, the existing target recognition methods can be further improved in terms of the target recognition performance and the ability against insufficient calibration. Significance. A new learning scheme is proposed towards the efficient use of the calibration data, providing enhanced performance and saving calibration time in the SSVEP-based BCIs.