Smartphone accelerometer data used for detecting human emotions

• Published in: 2016 3rd International Conference on Systems and Informatics (ICSAI) pp. 410 - 415
• Main Authors: Olsen, Andreas Fsrovig, Torresen, Jim
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.11.2016
• Subjects: Accelerometers; Affective computing; Computational modeling; Data collection; Emotion recognition; Mood; Sensors
• DOI: 10.1109/ICSAI.2016.7810990

The paper outlines work on the classification of emotions using smartphone accelerometer data. Such classification can be used, in conjunction with other methods of emotion detection, to adapt services to the user's emotional state. The data is collected from individuals who have been carrying their phone in a pocket while walking. An Android app was developed in order to monitor the smartphone accelerometer of the individuals who participated in the study and occasionally requested them to judge and submit their emotional state. This way, data is collected from a natural environment rather than a laboratory setting. The recorded data is then processed and used to train different classifiers to be compared. The machine learning algorithms decision tree, support vector machine and multilayer perceptron are used for this purpose. Emotions are classified in two dimensions: pleasantness and arousal (activation). While the recognition rate for the arousal dimension is promising at 75%, pleasantness is harder to predict, with a recognition rate of 51%. These findings indicate that by only analyzing accelerometer data recorded from a smartphone, it is possible to make predictions of a person's state of activation.