Gesture Recognition Intermediary Robot for Abnormality Detection in Human Activities

• Published in: 2019 IEEE Symposium Series on Computational Intelligence (SSCI) pp. 1415 - 1421
• Main Authors: Yahaya, Salisu Wada, Lotfi, Ahmad, Mahmud, Mufti, Machado, Pedro, Kubota, Naoyuki
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.12.2019
• Subjects: abnormality detection; Activities of Daily Living (ADL); anomaly detection; assistive robot; Cameras; Convolutional Neural Network (CNN); Feature extraction; Gesture recognition; Predictive models; Robot sensing systems; Streaming media; You Only Look Once (YOLO)
• DOI: 10.1109/SSCI44817.2019.9003121

The world ageing population is increasing, giving rise to research targeted towards improving the quality of life and promoting the independent living of older adults. Detecting abnormalities in the daily activities of the older adults is relevant since abnormalities can be an early sign of health decline, prompting for the need for intervention. Current approaches to abnormality detection involve modelling the usual behavioural routine of the individual as a baseline and comparing subsequent behaviour to the baseline to detect abnormalities. This approach is prone to errors and not flexible since it does not take into account changes in human behavioural routine. Training is usually performed on pre-existing data making the abnormality detection model non-adaptive to new incoming data. An intermediary can be incorporated to enable model predictions to be communicated to humans for verification of the detected anomalies. This paper proposes a gesture recognition approach for facilitating interaction between humans and a robot intermediary. A model capable of recognising hand gestures corresponding to affirmations and denials is implemented. Preliminary evaluation shows that the proposed gesture recognition approach has the potential of being utilised in an assistive robot intermediary.