CRONOS: Colorization and Contrastive Learning for Device-Free NLoS Human Presence Detection Using Wi-Fi CSI

• Published in: IEEE internet of things journal Vol. 11; no. 3; p. 1
• Main Authors: Shen, Li-Hsiang, Hsieh, Chia-Che, Hsiao, An-Hung, Feng, Kai-Ten
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.02.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: channel state information (CSI); Color; Colorization; Commercialization; deep learning; Device-free human presence detection; Feature extraction; Legged locomotion; Line of sight; Machine learning; Sensors; Task analysis; Wi-Fi; Wireless communication; Wireless fidelity; Wireless sensor networks
• ISSN: 2327-4662; 2327-4662
• DOI: 10.1109/JIOT.2023.3307001

In recent years, the demand for pervasive smart services and applications has increased rapidly. Device-free human detection through sensors or cameras has been widely adopted, but it comes with privacy issues as well as misdetection for motionless people. To address these drawbacks, channel state information (CSI) captured from commercialized Wi-Fi devices provides rich signal features for accurate detection. However, existing systems suffer from inaccurate classification under a non-line-of-sight (NLoS) and stationary scenario, such as when a person is standing still in a room corner. In this work, we propose a system called CRONOS (Colorization and Contrastive Learning Enhanced NLoS Human Presence Detection), which generates dynamic recurrence plots (RPs) and color-coded CSI ratios to distinguish mobile and stationary people from vacancy in a room, respectively. We also incorporate supervised contrastive learning to retrieve substantial representations, where consultation loss is formulated to differentiate the representative distances between dynamic and stationary cases. Furthermore, we propose a self-switched static feature enhanced classifier (S3FEC) to determine the utilization of either RPs or color-coded CSI ratios. Our comprehensive experimental results show that CRONOS outperforms existing systems that either apply machine learning or non-learning based methods, as well as non-CSI based features in open literature. CRONOS achieves the highest human presence detection accuracy in vacancy, mobility, line-of-sight (LoS), and NLoS scenarios.