Non-contact human respiratory rate measurement based on two-level fusions of video and FMCW radar information

• Published in: Measurement : journal of the International Measurement Confederation Vol. 222; p. 113604
• Main Authors: Song, Rencheng, Ren, Cong, Cheng, Juan, Li, Chang, Yang, Xuezhi
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 30.11.2023
• Subjects: FMCW radar; Non-contact measurement; Respiration rate; Two-level fusion; Video; Respiration rate; Non-contact measurement; Video; Two-level fusion; FMCW radar
• ISSN: 0263-2241
• DOI: 10.1016/j.measurement.2023.113604

In this paper, we propose a robust respiratory rate (RR) measurement method using a two-level fusion of video and FMCW (frequency modulated continuous wave) radar information. Specifically, the video pixel displacement signals and the radar phase variation signals are extracted independently in shoulders and chest regions, which are then denoised by the serial-CEEMDAN (SCEEMDAN) method to obtain the corresponding single modal RR values. Next, at the feature level, the multivariate singular spectrum analysis (MSSA) is employed to extract the shared respiratory components in the video and radar modalities. Finally, at the decision level, we calculate the target RR value based on a signal-to-noise ratio (SNR) weighting of all single-modality and MSSA results. The proposed two-level fusion method is evaluated on a self-collected dataset, which includes 15 healthy subjects acting five challenging activities. The experimental results show that the proposed fusion method significantly outperform that of the single modality. •The serial-CEEMDAN method is introduced to denoise the respiratory signals.•A two-level fusion method is proposed for motion robust respiratory measurements.•Experimental results in challenging scenarios verify the benefits of the method.