mm-MuRe: mmWave-Based Multi-Subject Respiration Monitoring via End-to-End Deep Learning

• Published in: IEEE journal of electromagnetics, RF and microwaves in medicine and biology Vol. 9; no. 1; pp. 49 - 61
• Main Authors: Bauder, Chandler, Moadi, Abdel-Kareem, Rajagopal, Vijaysrinivas, Wu, Tianhao, Liu, Jian, Fathy, Aly E.
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.03.2025; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Accuracy; Array signal processing; Artificial neural networks; Beam steering; Beamforming; Biomarkers; Biomedical monitoring; Biomedical telemetry; Deep learning; Localization; Machine learning; Millimeter waves; MIMO radar; Monitoring; Neural networks; Radar; Radar data; Real time; Reconstruction; Respiration; Telemedicine; Waveforms
• ISSN: 2469-7249; 2469-7257
• DOI: 10.1109/JERM.2024.3443782

This study presents mm-MuRe , a novel method to perform multi-subject contactless respiration waveform monitoring by processing raw multiple-input-multiple-output mmWave radar data with an end-to-end deep neural network. The traditional vital signs monitoring signal processing scheme for mmWave radar involves analog or digital beamforming, human subject localization, phase variation extraction, filtering, and rate or biomarker analysis. This traditional method has many downsides, including sensitivity to selected beamforming weights and over-reliance on phase variation. To avoid these drawbacks, mm-MuRe (for MM-wave based MUlti-subject REspiration monitoring) is developed to improve reconstruction accuracy and reliability by taking in unprocessed 60 GHz MIMO FMCW radar data and outputting respiratory waveforms of interest, effectively mimicking an adaptive beamformer and bypassing the need for traditional localization and vital signs extraction techniques. Extensive testing across scenarios differing in range, angle, environment, and subject count demonstrates the network's robust performance, with an average cosine similarity exceeding 0.95. Results are compared to two baseline methods and show more than a 10% average improvement in waveform reconstruction accuracy across single and multi-subject scenarios. Coupled with a rapid inference time of 8.57 ms on a 10 s window of data, mm-MuRe shows promise for potential deployment to efficient and accurate near-real-time contactless respiration monitoring systems.