Recognizing Detailed Human Context in the Wild from Smartphones and Smartwatches

• Published in: IEEE pervasive computing Vol. 16; no. 4; pp. 62 - 74
• Main Authors: Vaizman, Yonatan, Ellis, Katherine, Lanckriet, Gert
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.10.2017; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Aging (natural); artificial intelligence; Bioinformatics; Biomedical monitoring; Context awareness; Data collection; Domains; healthcare; human activity recognition; Intelligent systems; Internet of Things; Machine learning; mobile; Mobile sensors; Performance evaluation; Pervasive computing; Recognition; Smart phones; Smartphones; Smartwatches
• ISSN: 1536-1268; 1558-2590
• DOI: 10.1109/MPRV.2017.3971131

The ability to automatically recognize a person's behavioral context can contribute to health monitoring, aging care, and many other domains. Validating context recognition in the wild is crucial to promote practical applications that work in real-life settings. The authors collected more than 300,000 minutes of sensor data with context labels from 60 subjects. Unlike previous studies, these subjects used their own personal phone, in any way that was convenient to them, and engaged in their routine in their natural environments. Unscripted behavior and unconstrained phone usage resulted in situations that were harder to recognize. The authors demonstrate how fusion of multimodal sensors is important for resolving such cases. They present a baseline system and encourage researchers to use their public dataset to compare methods and improve context recognition in the wild.