A portable platform to collect and review behavioral data simultaneously with neurophysiological signals

• Published in: 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) Vol. 2017; pp. 1784 - 1787
• Main Authors: Tianxiao Jiang, Siddiqui, Hasan, Ray, Shruti, Asman, Priscella, Ozturk, Musa, Ince, Nuri F.
• Format: Conference Proceeding Journal Article
• Language: English
• Published: United States IEEE 01.07.2017
• Subjects: Data visualization; MATLAB; Real-time systems; Streaming media; Time-frequency analysis; Universal Serial Bus
• ISSN: 1557-170X
• DOI: 10.1109/EMBC.2017.8037190

This paper presents a portable platform to collect and review behavioral data simultaneously with neurophysiological signals. The whole system is comprised of four parts: a sensor data acquisition interface, a socket server for real-time data streaming, a Simulink system for real-time processing and an offline data review and analysis toolbox. A low-cost microcontroller is used to acquire data from external sensors such as accelerometer and hand dynamometer. The micro-controller transfers the data either directly through USB or wirelessly through a bluetooth module to a data server written in C++ for MS Windows OS. The data server also interfaces with the digital glove and captures HD video from webcam. The acquired sensor data are streamed under User Datagram Protocol (UDP) to other applications such as Simulink/Matlab for real-time analysis and recording. Neurophysiological signals such as electroencephalography (EEG), electrocorticography (ECoG) and local field potential (LFP) recordings can be collected simultaneously in Simulink and fused with behavioral data. In addition, we developed a customized Matlab Graphical User Interface (GUI) software to review, annotate and analyze the data offline. The software provides a fast, user-friendly data visualization environment with synchronized video playback feature. The software is also capable of reviewing long-term neural recordings. Other featured functions such as fast preprocessing with multithreaded filters, annotation, montage selection, power-spectral density (PSD) estimate, time-frequency map and spatial spectral map are also implemented.