Innovative approaches in imaging photoplethysmography for remote blood oxygen monitoring

• Published in: Scientific reports Vol. 14; no. 1; pp. 19144 - 13
• Main Authors: Zhu, Shangwei, Liu, Shaohua, Jing, Xingjian, Yang, Yuchong, She, Chundong
• Format: Journal Article
• Language: English
• Published: England Nature Publishing Group 19.08.2024; Nature Publishing Group UK; Nature Portfolio
• Subjects: COVID-19; COVID-19 - blood; COVID-19 - diagnosis; Humans; Imaging PhotoPlethysMography; ITSCAN; Monitoring, Physiologic - methods; Neural networks; Neural Networks, Computer; Oximetry - methods; Oxygen - blood; Oxygen Saturation; Pandemics; Photoplethysmography - methods; Public health; SARS-CoV-2 - isolation & purification; Smartphone; SpO2 estimation; Temporal shift convolution; ITSCAN; Temporal shift convolution; Imaging PhotoPlethysMography; SpO2 estimation
• ISSN: 2045-2322; 2045-2322
• DOI: 10.1038/s41598-024-70192-1

Peripheral Capillary Oxygen Saturation (SpO ) has received increasing attention during the COVID-19 pandemic. Clinical investigations have demonstrated that individuals afflicted with COVID-19 exhibit notably reduced levels of SpO before the deterioration of their health status. To cost-effectively enable individuals to monitor their SpO , this paper proposes a novel neural network model named "ITSCAN" based on Temporal Shift Module. Benefiting from the widespread use of smartphones, this model can assess an individual's SpO in real time, utilizing standard facial video footage, with a temporal granularity of seconds. The model is interweaved by two distinct branches: the motion branch, responsible for extracting spatiotemporal data features and the appearance branch, focusing on the correlation between feature channels and the location information of feature map using coordinate attention mechanisms. Accordingly, the SpO estimator generates the corresponding SpO value. This paper summarizes for the first time 5 loss functions commonly used in the SpO estimation model. Subsequently, a novel loss function has been contributed through the examination of various combinations and careful selection of hyperparameters. Comprehensive ablation experiments analyze the independent impact of each module on the overall model performance. Finally, the experimental results based on the public dataset (VIPL-HR) show that our model has obvious advantages in MAE (1.10%) and RMSE (1.19%) compared with related work, which implies more accuracy of the proposed method to contribute to public health.