Vision-Guided MIMO Radar Beamforming for Enhanced Vital Signs Detection in Crowds

• Published in: IEEE transactions on aerospace and electronic systems Vol. 60; no. 4; pp. 4640 - 4649
• Main Authors: Jiang, Shuaifeng, Alkhateeb, Ahmed, Bliss, Daniel W., Rong, Yu
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.08.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: 3-D depth camera; Algorithms; Beamforming; calibration; Cameras; Field of view; Human motion; Imaging; MIMO communication; MIMO radar; Monitoring; Motion perception; Optical measuring instruments; Radar; Radar detection; Radar imaging; Remote sensing; Remote sensors; Sensors; signal processing; Technology assessment; vital signs
• ISSN: 0018-9251; 1557-9603
• DOI: 10.1109/TAES.2024.3379492

Radar as a remote sensing technology has been used to analyze human activities for decades. Despite all the great features such as motion sensitivity, privacy preservation, penetrability, and more, radar has limited spatial degrees of freedom compared to optical sensors and, thus, makes it challenging to sense crowded environments without prior information. In this article, we develop a dual-sensing system, in which a vision sensor is leveraged to guide digital beamforming in a multiple-input multiple-output radar. Also, we develop a calibration algorithm to align the two types of sensors and show that the calibrated dual system achieves about 2 cm precision in 3-D space within a field of view of <inline-formula><tex-math notation="LaTeX">75^\circ</tex-math></inline-formula> × <inline-formula><tex-math notation="LaTeX">65^\circ</tex-math></inline-formula> and for a range of 2 m. Finally, we show that the proposed approach is capable of detecting the vital signs simultaneously for a group of closely spaced subjects, sitting and standing, in a cluttered environment, which highlights a promising direction for vital signs detection in realistic environments.