Hybrid statistical and machine learning modeling of cognitive neuroscience data

• Published in: Journal of applied statistics Vol. 51; no. 6; pp. 1076 - 1097
• Main Authors: Cakar, Serenay, Yavuz, Fulya Gokalp
• Format: Journal Article
• Language: English
• Published: England Taylor & Francis 25.04.2024; Taylor & Francis Ltd
• Subjects: Algorithms; cognitive studies; Computing time; Data analysis; Data structures; fNIRS; Infrared spectra; Machine learning; mixed model; n-back data; Near infrared radiation; Neurosciences; Performance measurement; Performance prediction; Statistical methods; fNIRS; mixed model; cognitive studies; Machine learning; n-back data
• ISSN: 0266-4763; 1360-0532
• DOI: 10.1080/02664763.2023.2176834

The nested data structure is prevalent for cognitive measure experiments due to repeatedly taken observations from different brain locations within subjects. The analysis methods used for this data type should consider the dependency structure among the repeated measurements. However, the dependency assumption is mainly ignored in the cognitive neuroscience data analysis literature. We consider both statistical, and machine learning methods extended to repeated data analysis and compare distinct algorithms in terms of their advantage and disadvantages. Unlike basic algorithm comparison studies, this article analyzes novel neuroscience data considering the dependency structure for the first time with several statistical and machine learning methods and their hybrid forms. In addition, the fitting performances of different algorithms are compared using contaminated data sets, and the cross-validation approach. One of our findings suggests that the GLMM tree, including random term indices indicating the location of functional near-infrared spectroscopy optodes nested within experimental units, shows the best predictive performance with the lowest MSE, RMSE, and MAE model performance metrics. However, there is a trade-off between accuracy and speed since this algorithm is required the highest computational time.