Robust Method for Non-Contact Vital Sign Measurement in Videos Acquired in Real-World Light Settings from Skin Less Affected by Blood Perfusion
Color fluctuations caused by blood perfusion on the skin are an essential tool for the success of imaging photoplethysmography (iPPG) methods. However, color fluctuation of the non-facial skin is less observable than that of the facial skin. Furthermore, some light sources may produce image artifact...
Saved in:
Published in | IEEE access Vol. 12; p. 1 |
---|---|
Main Authors | , |
Format | Journal Article |
Language | English |
Published |
Piscataway
IEEE
01.01.2024
The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
Subjects | |
Online Access | Get full text |
ISSN | 2169-3536 2169-3536 |
DOI | 10.1109/ACCESS.2024.3367775 |
Cover
Abstract | Color fluctuations caused by blood perfusion on the skin are an essential tool for the success of imaging photoplethysmography (iPPG) methods. However, color fluctuation of the non-facial skin is less observable than that of the facial skin. Furthermore, some light sources may produce image artifacts obscuring vital signs that iPPG methods are aimed to observe. This work contributes to an iPPG domain in several ways. First, it systematically visualizes and evaluates the impact of light settings on the accuracy of heart-rate estimation. Three light settings were arranged, and Eulerian video magnification was applied to illustrate their underlying characteristics. This work showed that fluorescent tubes could produce stripe artifacts and failed existing iPPG methods. Second, techniques to strengthen blood perfusion signals and better estimate heart rates are proposed. They significantly improved the accuracy in three light settings and a wide range of skin types categorized by the Fitzpatrick standard. Lastly, this work presents a new public dataset acquired from the forearm skin of 83 human subjects. The proposed method utilizes the Savitzky-Golay filter to treat components obtained by independent component analysis (ICA). We apply normalized autocorrelation to evaluate signals' period consistency and weigh ICA components accordingly. This method is a reliable way to accumulate weighted fast Fourier Transform spectra and compute the final frequency representing an estimated heart rate. In our experiments, the method significantly reduced the errors of prior methods in all of the three light settings, especially for ceiling fluorescent tubes where the errors were reduced by 83% on average. |
---|---|
AbstractList | Color fluctuations caused by blood perfusion on the skin are an essential tool for the success of imaging photoplethysmography (iPPG) methods. However, color fluctuation of the non-facial skin is less observable than that of the facial skin. Furthermore, some light sources may produce image artifacts obscuring vital signs that iPPG methods are aimed to observe. This work contributes to an iPPG domain in several ways. First, it systematically visualizes and evaluates the impact of light settings on the accuracy of heart-rate estimation. Three light settings were arranged, and Eulerian video magnification was applied to illustrate their underlying characteristics. This work showed that fluorescent tubes could produce stripe artifacts and failed existing iPPG methods. Second, techniques to strengthen blood perfusion signals and better estimate heart rates are proposed. They significantly improved the accuracy in three light settings and a wide range of skin types categorized by the Fitzpatrick standard. Lastly, this work presents a new public dataset acquired from the forearm skin of 83 human subjects. The proposed method utilizes the Savitzky-Golay filter to treat components obtained by independent component analysis (ICA). We apply normalized autocorrelation to evaluate signals' period consistency and weigh ICA components accordingly. This method is a reliable way to accumulate weighted fast Fourier Transform spectra and compute the final frequency representing an estimated heart rate. In our experiments, the method significantly reduced the errors of prior methods in all of the three light settings, especially for ceiling fluorescent tubes where the errors were reduced by 83% on average. |
Author | Taeprasartsit, Pinyo Tangjui, Nattapong |
Author_xml | – sequence: 1 givenname: Nattapong orcidid: 0009-0009-5715-5576 surname: Tangjui fullname: Tangjui, Nattapong organization: Department of Computing, Faculty of Science Silpakorn University, Nakhon Pathom, Thailand – sequence: 2 givenname: Pinyo surname: Taeprasartsit fullname: Taeprasartsit, Pinyo organization: Department of Computing, Faculty of Science Silpakorn University, Nakhon Pathom, Thailand |
BookMark | eNpNkctu1DAUhiNUJErpE8DCEusMvsbJcogKVBouargsLTs5nnrI2K3tLPoUvDIeUqGeje3j__vPkf6X1ZkPHqrqNcEbQnD3btv3V8OwoZjyDWONlFI8q84pabqaCdacPbm_qC5TOuBSbWkJeV79uQlmSRl9hnwbJmRDRF-Cr_vgsx4z-umyntHg9r4odFoiHMFn5Hz5mSAktB3vFxdhOrVuQM_1rxDnCe3c_jajAXJ2fp-QjeGIht9Fs4NUIGthzAUyD-j9HMrcbxDtklzwr6rnVs8JLh_Pi-rHh6vv_ad69_Xjdb_d1SMTXa6p6WjLiW6pIdryFmsrDBENdHg0DZGMghGG2_JguitqbsFQrekoZVEwdlFdr75T0Ad1F91RxwcVtFP_GiHulY7ZjTOoltOOMaASpORdKzUWQhJthBVE0IYXr7er110M9wukrA5hib6srwpJhRRlwaJiq2qMIaUI9v9UgtUpSLUGqU5BqscgC_VmpRwAPCE4x6zUX5iCmz0 |
CODEN | IAECCG |
Cites_doi | 10.1109/tbme.2010.2086456 10.1109/access.2017.2678521 10.1016/0165-1684(94)90029-9 10.1109/taffc.2021.3056960 10.1080/00015550310015419 10.1111/sms.12604 10.1088/0967-3334/37/5/n27 10.1186/1475-2840-8-55 10.1109/bhi.2016.7455830 10.1016/j.earlhumdev.2013.09.016 10.1109/memea.2014.6860029 10.1111/srt.12020 10.3390/app9204474 10.1080/21681163.2018.1441075 10.1038/s41746-019-0199-5 10.1021/ac60214a047 10.1016/j.pisc.2016.06.056 10.1109/jcsse.2016.7748888 10.1109/memea.2016.7533818 10.1371/journal.pone.0071384 10.1145/2683405.2683446 10.1088/0967-3334/28/3/r01 10.1152/japplphysiol.01281.2006 10.1063/1.2724789 10.1371/journal.pone.0202581 10.1109/tbme.2013.2266196 10.1109/icce.2019.8661915 10.1162/089976699300016863 10.4103/tjps.tjps_2_17 10.3758/s13428-019-01256-8 10.1001/archderm.124.6.869 10.1145/2185520.2185561 10.1049/htl.2014.0077 10.1109/tbme.2014.2356291 10.1109/mva.2015.7153099 10.1364/oe.18.010762 10.1007/s10439-005-5763-2 10.1109/iementech.2018.8465225 10.1007/s00276-002-0034-5 10.1109/10.979357 10.1016/j.ijms.2013.01.003 10.1109/tbme.2014.2323695 10.1109/access.2017.2735419 10.1093/oxfordjournals.aje.a009901 10.1109/cvpr.2013.440 |
ContentType | Journal Article |
Copyright | Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024 |
Copyright_xml | – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024 |
DBID | 97E ESBDL RIA RIE AAYXX CITATION 7SC 7SP 7SR 8BQ 8FD JG9 JQ2 L7M L~C L~D DOA |
DOI | 10.1109/ACCESS.2024.3367775 |
DatabaseName | IEEE Xplore (IEEE) IEEE Xplore Open Access Journals IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE/IET Electronic Library CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Engineered Materials Abstracts METADEX Technology Research Database Materials Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional DOAJ Directory of Open Access Journals |
DatabaseTitle | CrossRef Materials Research Database Engineered Materials Abstracts Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace METADEX Computer and Information Systems Abstracts Professional |
DatabaseTitleList | Materials Research Database |
Database_xml | – sequence: 1 dbid: DOA name: DOAJ Open Access Full Text url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: RIE name: IEEE Electronic Library (IEL) url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Engineering |
EISSN | 2169-3536 |
EndPage | 1 |
ExternalDocumentID | oai_doaj_org_article_842933e27e774987a05571ab5f515264 10_1109_ACCESS_2024_3367775 10440333 |
Genre | orig-research |
GroupedDBID | 0R~ 5VS 6IK 97E AAJGR ABAZT ABVLG ACGFS ADBBV ALMA_UNASSIGNED_HOLDINGS BCNDV BEFXN BFFAM BGNUA BKEBE BPEOZ EBS ESBDL GROUPED_DOAJ IPLJI JAVBF KQ8 M43 M~E O9- OCL OK1 RIA RIE RNS 4.4 AAYXX AGSQL CITATION EJD RIG 7SC 7SP 7SR 8BQ 8FD JG9 JQ2 L7M L~C L~D |
ID | FETCH-LOGICAL-c359t-2b92841a82b1af480af5b156e90cb61732eb5b4fcb63a92b94feb2aa2c770cb33 |
IEDL.DBID | DOA |
ISSN | 2169-3536 |
IngestDate | Wed Aug 27 01:24:56 EDT 2025 Mon Jun 30 07:02:29 EDT 2025 Tue Jul 01 04:14:22 EDT 2025 Wed Aug 27 02:09:32 EDT 2025 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | true |
IsScholarly | true |
Language | English |
License | https://creativecommons.org/licenses/by-nc-nd/4.0 |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c359t-2b92841a82b1af480af5b156e90cb61732eb5b4fcb63a92b94feb2aa2c770cb33 |
Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
ORCID | 0009-0009-5715-5576 0000-0003-3911-725X |
OpenAccessLink | https://doaj.org/article/842933e27e774987a05571ab5f515264 |
PQID | 2932575480 |
PQPubID | 4845423 |
PageCount | 1 |
ParticipantIDs | doaj_primary_oai_doaj_org_article_842933e27e774987a05571ab5f515264 crossref_primary_10_1109_ACCESS_2024_3367775 ieee_primary_10440333 proquest_journals_2932575480 |
ProviderPackageCode | CITATION AAYXX |
PublicationCentury | 2000 |
PublicationDate | 2024-01-01 |
PublicationDateYYYYMMDD | 2024-01-01 |
PublicationDate_xml | – month: 01 year: 2024 text: 2024-01-01 day: 01 |
PublicationDecade | 2020 |
PublicationPlace | Piscataway |
PublicationPlace_xml | – name: Piscataway |
PublicationTitle | IEEE access |
PublicationTitleAbbrev | Access |
PublicationYear | 2024 |
Publisher | IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
Publisher_xml | – name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
References | ref13 ref12 ref15 ref14 ref11 ref10 Angrisani (ref47) ref17 ref16 ref19 Chambino (ref18) 2013 Murphy (ref41) 2021 ref51 ref50 ref46 Butterworth (ref36) 1930; 7 Guinón (ref45) ref48 ref42 ref44 ref43 ref49 ref7 ref9 ref4 ref3 ref6 ref5 ref40 ref35 ref34 ref37 ref31 ref30 ref33 ref32 ref2 ref1 ref39 ref38 ref24 ref23 ref26 ref25 ref20 ref22 ref21 Lewandowska (ref8) ref28 ref27 ref29 |
References_xml | – start-page: 1116 volume-title: Proc. 20th IMEKO TC4 ident: ref47 article-title: The effect of Savitzky–Golay smoothing filter on the performance of a vehicular dynamic spectrum access method – ident: ref9 doi: 10.1109/tbme.2010.2086456 – ident: ref17 doi: 10.1109/access.2017.2678521 – ident: ref14 doi: 10.1016/0165-1684(94)90029-9 – ident: ref38 doi: 10.1109/taffc.2021.3056960 – ident: ref23 doi: 10.1080/00015550310015419 – ident: ref34 doi: 10.1111/sms.12604 – ident: ref2 doi: 10.1088/0967-3334/37/5/n27 – ident: ref51 doi: 10.1186/1475-2840-8-55 – start-page: 405 volume-title: Proc. Federated Conf. Comput. Sci. Inf. Syst. (FedCSIS) ident: ref8 article-title: Measuring pulse rate with a webcam—A non-contact method for evaluating cardiac activity – ident: ref29 doi: 10.1109/bhi.2016.7455830 – ident: ref19 doi: 10.1016/j.earlhumdev.2013.09.016 – ident: ref26 doi: 10.1109/memea.2014.6860029 – ident: ref25 doi: 10.1111/srt.12020 – ident: ref4 doi: 10.3390/app9204474 – ident: ref30 doi: 10.1080/21681163.2018.1441075 – ident: ref21 doi: 10.1038/s41746-019-0199-5 – ident: ref35 doi: 10.1021/ac60214a047 – ident: ref46 doi: 10.1016/j.pisc.2016.06.056 – ident: ref42 doi: 10.1109/jcsse.2016.7748888 – ident: ref28 doi: 10.1109/memea.2016.7533818 – ident: ref1 doi: 10.1371/journal.pone.0071384 – ident: ref16 doi: 10.1145/2683405.2683446 – ident: ref6 doi: 10.1088/0967-3334/28/3/r01 – ident: ref33 doi: 10.1152/japplphysiol.01281.2006 – ident: ref7 doi: 10.1063/1.2724789 – ident: ref13 doi: 10.1371/journal.pone.0202581 – ident: ref11 doi: 10.1109/tbme.2013.2266196 – ident: ref44 doi: 10.1109/icce.2019.8661915 – ident: ref43 doi: 10.1162/089976699300016863 – ident: ref31 doi: 10.4103/tjps.tjps_2_17 – ident: ref32 doi: 10.3758/s13428-019-01256-8 – ident: ref37 doi: 10.1001/archderm.124.6.869 – year: 2021 ident: ref41 publication-title: Pulse Sensor Amped Processing Visualizer – ident: ref10 doi: 10.1145/2185520.2185561 – ident: ref20 doi: 10.1049/htl.2014.0077 – ident: ref12 doi: 10.1109/tbme.2014.2356291 – ident: ref27 doi: 10.1109/mva.2015.7153099 – ident: ref48 doi: 10.1364/oe.18.010762 – start-page: 1 volume-title: Proc. Int. Conf. Eng. Educ. ident: ref45 article-title: Moving average and Savitzki–Golay smoothing filters using Mathcad – volume: 7 start-page: 536 year: 1930 ident: ref36 article-title: On the theory of filter amplifiers publication-title: Exp.WirelessWireless Eng. – ident: ref5 doi: 10.1007/s10439-005-5763-2 – year: 2013 ident: ref18 article-title: Android-based implementation of Eulerian video magnification for vital signs monitoring – ident: ref39 doi: 10.1109/iementech.2018.8465225 – ident: ref22 doi: 10.1007/s00276-002-0034-5 – ident: ref40 doi: 10.1109/10.979357 – ident: ref49 doi: 10.1016/j.ijms.2013.01.003 – ident: ref15 doi: 10.1109/tbme.2014.2323695 – ident: ref3 doi: 10.1109/access.2017.2735419 – ident: ref50 doi: 10.1093/oxfordjournals.aje.a009901 – ident: ref24 doi: 10.1109/cvpr.2013.440 |
SSID | ssj0000816957 |
Score | 2.3002102 |
Snippet | Color fluctuations caused by blood perfusion on the skin are an essential tool for the success of imaging photoplethysmography (iPPG) methods. However, color... |
SourceID | doaj proquest crossref ieee |
SourceType | Open Website Aggregation Database Index Database Publisher |
StartPage | 1 |
SubjectTerms | Biomedical monitoring Blood Color Electron tubes Fast Fourier transformations FFT Fitzpatrick standard Fluorescence Fourier transforms Heart rate Image color analysis Independent component analysis iPPG Light Light sources Methods Monitoring non-facial pulse measurement Principal component analysis Pulse measurements Skin Tubes Videos Wrist |
SummonAdditionalLinks | – databaseName: IEEE/IET Electronic Library dbid: RIE link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Lb9QwELZoT3DgWcRCQT5wxEsS2xv7uF1RVaisUEtRb5btjFFVKUHd5AB_gr_MjJNdrUBI3PKwE0fjxzeTz98w9jYaWWqQQaTGK6FMo4VFWCRUVIvoPYU-MkF2vTi7Uh-v9fW0WT3vhQGATD6DOR3mf_lNFwcKleEIV6qQUh6wA-xn42atXUCFMkhYXU_KQmVh3y9XK_wI9AErNZdyUddEJtxbfbJI_5RV5a-pOK8vp4_YetuykVZyOx_6MI8__xBt_O-mP2YPJ6TJl2PXeMLuQfuUPdjTH3zGfl10Ydj0_FNOI80Rv_J11wpSrPKx518poQi_vPnWYoldKJHftHingW7Dl5F4xNDQpQtEnCJTc_g5Ofz8EjKlesNpBwunJF_8HKdVvswMEqwUfvATos3zz3CXBoraHbGr0w9fVmdiytAgotS2F1WwuLyV3lSh9EmZwicd0CMEW8SA2EhWEHRQCU-kt1haJfTkva9iXWMJKZ-zw7Zr4QXjqpHJSqtTMggiKzCqSTaVxqYCIs4TM_Zuazn3fRTicNmBKawbDe3I0G4y9IydkHV3RUlFO19Aq7hpUDqDi7GUUNWAINia2pMgWemDTojyECnO2BFZcu99oxFn7HjbWdw05DcOH4XTH8nnvfxHtVfsfkXZg0kpcnHMDvu7AV4jpOnDm9yVfwP5FPM3 priority: 102 providerName: IEEE |
Title | Robust Method for Non-Contact Vital Sign Measurement in Videos Acquired in Real-World Light Settings from Skin Less Affected by Blood Perfusion |
URI | https://ieeexplore.ieee.org/document/10440333 https://www.proquest.com/docview/2932575480 https://doaj.org/article/842933e27e774987a05571ab5f515264 |
Volume | 12 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1LT9wwELYQp3JAfVCxLUVz4IhLEtsb-7isukKIIgSl4mbZjl1xaIJ2s4f-iv7lzjgBReqhlx7jTOLYM56XJt8wdhK0KFUUnqfGSS51o7hBt4jLIOfBOUp95ALZ6_nFvbx8UA-TVl9UEzbAAw8bd6ZRYQoRqzqio4IBsiPQqNJ5ldASozUn7VuYYhJMZR2sy7lR9QgzVBbmbLFc4oowIKzkZyHmdU2VhRNTlBH7xxYrf-nlbGxWr9n-6CXCYvi6N2wntm_Z3gQ78B37fdv57aaHr7kFNKDvCdddywltyoUevlMzELh7_NEixUsaEB5bvNPEbgOLQDXAsaGhW_QWeS6rgSsK1uEu5nLoDazW3U-gBl1whSoRFrn6Ax_yv-CcSt7hJq7TljJuB-x-9eXb8oKP3RV4EMr0vPIGTVPpdOVLl6QuXFIeo7loiuDRrxFV9MrLhBfCGaSWCaNw56pQ10ghxHu223ZtPGQgG5GMMColjQ5gFbVskkmlNqmIAc_4jJ0-b7R9GkA0bA4-CmMHvljiix35MmPnxIwXUkLAzgMoF3aUC_svuZixA2LlZD4pCyHEjB0989aOx3Vj8VWougj67sP_mPsje0XrGTI1R2y3X2_jJ_Rden-cxfQ4_2b4B7AS6B4 |
linkProvider | Directory of Open Access Journals |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3Pb9MwFLZgHIAD48cQhQ184IhLEtuNfeyqTQW6Cu0H2s2yHXuakJJpTQ7jn-Bf5j0nrSrQJG5tYjeunu33vZfP3yPko1c8l4E7FisrmFCVZBpgERNeTLy1mPpIBNnlZH4hvl7Ky-GwejoLE0JI5LMwxo_pXX7V-A5TZbDChcg45w_JI3D8QvbHtTYpFawhoWU5aAvlmf48nc3gb0AUWIgx55OyRDrhlv9JMv1DXZV_NuPkYY53yXI9tp5Y8nPctW7sf_0l2_jfg39Ong1Yk077yfGCPAj1S_J0S4HwFfl92rhu1dKTVEiaAoKly6ZmqFllfUt_YEkRenZ9VUOLTTKRXtdwpwrNik49MolDhZdOAXOyRM6hCwz56VlIpOoVxTMsFMt80QVsrHSaOCTQyd3RQyTO0-_hNnaYt9sjF8dH57M5G2o0MM-lblnhNDi43KrC5TYKldkoHcSEQWfeATriRXDSiQhfuNXQWkSI5a0tfFlCC85fk526qcMbQkXFo-ZaxqgARhZBiSrqmCsds-BhpxiRT2vLmZteisOkECbTpje0QUObwdAjcojW3TRFHe10AaxihmVpFLhjzkNRBoDBWpUWJcly62QEnAdYcUT20JJbz-uNOCL768lihkW_MvBTsAGigN7be7p9II_n5ycLs_iy_PaOPMHh9umcfbLT3nbhAABO696naf0H1bv2eg |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Robust+Method+for+Non-Contact+Vital+Sign+Measurement+in+Videos+Acquired+in+Real-World+Light+Settings+From+Skin+Less+Affected+by+Blood+Perfusion&rft.jtitle=IEEE+access&rft.au=Nattapong+Tangjui&rft.au=Pinyo+Taeprasartsit&rft.date=2024-01-01&rft.pub=IEEE&rft.eissn=2169-3536&rft.volume=12&rft.spage=28582&rft.epage=28597&rft_id=info:doi/10.1109%2FACCESS.2024.3367775&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_842933e27e774987a05571ab5f515264 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2169-3536&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2169-3536&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2169-3536&client=summon |