Keynote: Data Scarcity in Sensor-Based Human Activity Recognition

• Published in: IEEE International Conference on Pervasive Computing and Communications workshops (Online) p. 420
• Main Author: Civitarese, Gabriele
• Format: Conference Proceeding
• Language: English
• Published: IEEE 13.03.2023
• ISSN: 2766-8576
• DOI: 10.1109/PerComWorkshops56833.2023.10150363

Sensor-based Human Activity Recognition (HAR) is a research field that has been widely studied in Pervasive Computing. Due to its many applications from healthcare to well-being, sensor-based HAR has been proposed to recognize high-level activities considering smart-homes environmental sensors as well as low-level activities using wearable sensors. The most effective solutions presented so far rely on supervised learning approaches, that have the potential of reaching high recognition rates. However, such approaches assume that large amounts of labeled data are available. Annotating human activities is costly, time-consuming, intrusive, and often prohibitive. Considering the high variability of activity execution among different subjects, methods that are capable of personalizing to each subject with limited labeled data are needed. In the last few years, several research groups are indeed working hard trying to mitigate this problem. However, data scarcity still remains an open challenge in sensor-based HAR. This talk presents latest research efforts on these topics. In particular, the talk will cover: a) purely knowledge-based approaches enhanced with active learning for smart-home sensor data, b) hybrid data-driven and knowledge-based approaches relying on context data to mitigate data scarcity in mobile settings, and c) semi-supervised federated learning approaches. We will discuss the above-mentioned challenges, report our experience and identify critical aspects which still need to be investigated.