RAPID: Retrofitting IEEE 802.11ay Access Points for Indoor Human Detection and Sensing

• Published in: arXiv.org
• Main Authors: Pegoraro, Jacopo, Jesus Omar Lacruz, Meneghello, Francesca, Bashirov, Enver, Rossi, Michele, Widmer, Joerg
• Format: Paper Journal Article
• Language: English
• Published: Ithaca Cornell University Library, arXiv.org 25.06.2024
• Subjects: Activity recognition; Antenna arrays; Communications systems; Doppler effect; Duplex plating; Field programmable gate arrays; Hardware; Human motion; Human performance; Impulse response; Millimeter waves; Packet transmission; Radar equipment; Retrofitting; Tracking; Wireless networks
• ISSN: 2331-8422
• DOI: 10.48550/arxiv.2109.04819

In this work we present RAPID, the first joint communication and radar system based on next-generation IEEE 802.11ay WiFi networks operating in the 60 GHz band. Unlike existing approaches for human sensing at millimeter-wave frequencies, which rely on special-purpose radars, RAPID achieves radar-level sensing accuracy with IEEE 802.11ay access points, thus avoiding the burden of installing ad-hoc sensors. RAPID enables contactless human sensing applications, such as people tracking, Human Activity Recognition (HAR), and person identification without requiring modifications to the standard packet structure. Specifically, we leverage IEEE 802.11ay beam training to accurately localize and track multiple individuals within the same environment. Then, we propose a new way of using beam tracking to extract micro-Doppler signatures from the time-varying Channel Impulse Response (CIR) estimated from reflected packets. Such signatures are fed to a deep learning classifier to perform HAR and person identification. RAPID is implemented on a cutting-edge IEEE 802.11ay-compatible FPGA platform with phased antenna arrays, and evaluated on a large dataset of CIR measurements. It is robust across different environments and subjects, and outperforms state-of-the-art sub-6 GHz WiFi sensing techniques. Using two access points, RAPID reliably tracks multiple subjects, reaching HAR and person identification accuracies of 94% and 90%, respectively.