Assessing visual attributes of handwriting for prediction of neurological disorders—A case study on Parkinson’s disease

• Published in: Pattern recognition letters Vol. 121; pp. 19 - 27
• Main Authors: Moetesum, Momina, Siddiqi, Imran, Vincent, Nicole, Cloppet, Florence
• Format: Journal Article
• Language: English
• Published: Amsterdam Elsevier B.V 15.04.2019; Elsevier Science Ltd; Elsevier
• Subjects: Artificial neural networks; Balance; Brain; Central nervous system; Change detection; Computer Science; Convolutional neural networks; Diagnostic systems; Feature extraction; Graphical representations; Handwriting; Movement disorders; Muscles; Neural networks; Neurodegenerative diseases; Neurological diseases; Parkinson's disease; Single photon emission computed tomography; Support vector machines; Tremors; Visual attributes; Visual discrimination; Handwriting; Visual attributes; Convolutional neural networks; Parkinson’s disease
• ISSN: 0167-8655; 1872-7344
• DOI: 10.1016/j.patrec.2018.04.008

•Investigation of visual attributes of handwriting to predict Parkison’s Disease.•Use of Convolutional Neural Networks for automatic feature extraction.•Multiple representations of raw data to enhance feature extraction step.•Evaluations on a standard template including drawing and writing tasks.•Fusion of predictions from multiple tasks to enhance performance. Parkinson’s disease (PD) is a degenerative disorder that progressively affects the central nervous system causing muscle rigidity, tremors, slowed movements and impaired balance. Sophisticated diagnostic procedures like SPECT scans can detect changes in the brain caused by PD but are only effective once the disease has advanced considerably. Analysis of subtle variations in handwriting and speech can serve as potential tools for early prediction of the disease. While traditional techniques mostly rely on dynamic (kinematic and spatio-temporal) features of handwriting, in this study, we quantitatively evaluate the visual attributes in characterization of graphomotor samples of PD patients. For this purpose, Convolutional Neural Networks are employed to extract discriminating visual features from multiple representations of various graphomotor samples produced by both control and PD subjects. The extracted features are then fed to a Support Vector Machine (SVM) classifier. Evaluations are carried out on a dataset of 72 subjects using early and late fusion techniques and an overall accuracy of 83% is realized with solely visual information.