Robust Method for Non-Contact Vital Sign Measurement in Videos Acquired in Real-World Light Settings from Skin Less Affected by Blood Perfusion

Color fluctuations caused by blood perfusion on the skin are an essential tool for the success of imaging photoplethysmography (iPPG) methods. However, color fluctuation of the non-facial skin is less observable than that of the facial skin. Furthermore, some light sources may produce image artifact...

Full description

Saved in:
Bibliographic Details
Published inIEEE access Vol. 12; p. 1
Main Authors Tangjui, Nattapong, Taeprasartsit, Pinyo
Format Journal Article
LanguageEnglish
Published Piscataway IEEE 01.01.2024
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects
Online AccessGet full text
ISSN2169-3536
2169-3536
DOI10.1109/ACCESS.2024.3367775

Cover

Abstract Color fluctuations caused by blood perfusion on the skin are an essential tool for the success of imaging photoplethysmography (iPPG) methods. However, color fluctuation of the non-facial skin is less observable than that of the facial skin. Furthermore, some light sources may produce image artifacts obscuring vital signs that iPPG methods are aimed to observe. This work contributes to an iPPG domain in several ways. First, it systematically visualizes and evaluates the impact of light settings on the accuracy of heart-rate estimation. Three light settings were arranged, and Eulerian video magnification was applied to illustrate their underlying characteristics. This work showed that fluorescent tubes could produce stripe artifacts and failed existing iPPG methods. Second, techniques to strengthen blood perfusion signals and better estimate heart rates are proposed. They significantly improved the accuracy in three light settings and a wide range of skin types categorized by the Fitzpatrick standard. Lastly, this work presents a new public dataset acquired from the forearm skin of 83 human subjects. The proposed method utilizes the Savitzky-Golay filter to treat components obtained by independent component analysis (ICA). We apply normalized autocorrelation to evaluate signals' period consistency and weigh ICA components accordingly. This method is a reliable way to accumulate weighted fast Fourier Transform spectra and compute the final frequency representing an estimated heart rate. In our experiments, the method significantly reduced the errors of prior methods in all of the three light settings, especially for ceiling fluorescent tubes where the errors were reduced by 83% on average.
AbstractList Color fluctuations caused by blood perfusion on the skin are an essential tool for the success of imaging photoplethysmography (iPPG) methods. However, color fluctuation of the non-facial skin is less observable than that of the facial skin. Furthermore, some light sources may produce image artifacts obscuring vital signs that iPPG methods are aimed to observe. This work contributes to an iPPG domain in several ways. First, it systematically visualizes and evaluates the impact of light settings on the accuracy of heart-rate estimation. Three light settings were arranged, and Eulerian video magnification was applied to illustrate their underlying characteristics. This work showed that fluorescent tubes could produce stripe artifacts and failed existing iPPG methods. Second, techniques to strengthen blood perfusion signals and better estimate heart rates are proposed. They significantly improved the accuracy in three light settings and a wide range of skin types categorized by the Fitzpatrick standard. Lastly, this work presents a new public dataset acquired from the forearm skin of 83 human subjects. The proposed method utilizes the Savitzky-Golay filter to treat components obtained by independent component analysis (ICA). We apply normalized autocorrelation to evaluate signals' period consistency and weigh ICA components accordingly. This method is a reliable way to accumulate weighted fast Fourier Transform spectra and compute the final frequency representing an estimated heart rate. In our experiments, the method significantly reduced the errors of prior methods in all of the three light settings, especially for ceiling fluorescent tubes where the errors were reduced by 83% on average.
Author Taeprasartsit, Pinyo
Tangjui, Nattapong
Author_xml – sequence: 1
  givenname: Nattapong
  orcidid: 0009-0009-5715-5576
  surname: Tangjui
  fullname: Tangjui, Nattapong
  organization: Department of Computing, Faculty of Science Silpakorn University, Nakhon Pathom, Thailand
– sequence: 2
  givenname: Pinyo
  surname: Taeprasartsit
  fullname: Taeprasartsit, Pinyo
  organization: Department of Computing, Faculty of Science Silpakorn University, Nakhon Pathom, Thailand
BookMark eNpNkctu1DAUhiNUJErpE8DCEusMvsbJcogKVBouargsLTs5nnrI2K3tLPoUvDIeUqGeje3j__vPkf6X1ZkPHqrqNcEbQnD3btv3V8OwoZjyDWONlFI8q84pabqaCdacPbm_qC5TOuBSbWkJeV79uQlmSRl9hnwbJmRDRF-Cr_vgsx4z-umyntHg9r4odFoiHMFn5Hz5mSAktB3vFxdhOrVuQM_1rxDnCe3c_jajAXJ2fp-QjeGIht9Fs4NUIGthzAUyD-j9HMrcbxDtklzwr6rnVs8JLh_Pi-rHh6vv_ad69_Xjdb_d1SMTXa6p6WjLiW6pIdryFmsrDBENdHg0DZGMghGG2_JguitqbsFQrekoZVEwdlFdr75T0Ad1F91RxwcVtFP_GiHulY7ZjTOoltOOMaASpORdKzUWQhJthBVE0IYXr7er110M9wukrA5hib6srwpJhRRlwaJiq2qMIaUI9v9UgtUpSLUGqU5BqscgC_VmpRwAPCE4x6zUX5iCmz0
CODEN IAECCG
Cites_doi 10.1109/tbme.2010.2086456
10.1109/access.2017.2678521
10.1016/0165-1684(94)90029-9
10.1109/taffc.2021.3056960
10.1080/00015550310015419
10.1111/sms.12604
10.1088/0967-3334/37/5/n27
10.1186/1475-2840-8-55
10.1109/bhi.2016.7455830
10.1016/j.earlhumdev.2013.09.016
10.1109/memea.2014.6860029
10.1111/srt.12020
10.3390/app9204474
10.1080/21681163.2018.1441075
10.1038/s41746-019-0199-5
10.1021/ac60214a047
10.1016/j.pisc.2016.06.056
10.1109/jcsse.2016.7748888
10.1109/memea.2016.7533818
10.1371/journal.pone.0071384
10.1145/2683405.2683446
10.1088/0967-3334/28/3/r01
10.1152/japplphysiol.01281.2006
10.1063/1.2724789
10.1371/journal.pone.0202581
10.1109/tbme.2013.2266196
10.1109/icce.2019.8661915
10.1162/089976699300016863
10.4103/tjps.tjps_2_17
10.3758/s13428-019-01256-8
10.1001/archderm.124.6.869
10.1145/2185520.2185561
10.1049/htl.2014.0077
10.1109/tbme.2014.2356291
10.1109/mva.2015.7153099
10.1364/oe.18.010762
10.1007/s10439-005-5763-2
10.1109/iementech.2018.8465225
10.1007/s00276-002-0034-5
10.1109/10.979357
10.1016/j.ijms.2013.01.003
10.1109/tbme.2014.2323695
10.1109/access.2017.2735419
10.1093/oxfordjournals.aje.a009901
10.1109/cvpr.2013.440
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024
DBID 97E
ESBDL
RIA
RIE
AAYXX
CITATION
7SC
7SP
7SR
8BQ
8FD
JG9
JQ2
L7M
L~C
L~D
DOA
DOI 10.1109/ACCESS.2024.3367775
DatabaseName IEEE Xplore (IEEE)
IEEE Xplore Open Access Journals
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE/IET Electronic Library
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Engineered Materials Abstracts
METADEX
Technology Research Database
Materials Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
Materials Research Database
Engineered Materials Abstracts
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
METADEX
Computer and Information Systems Abstracts Professional
DatabaseTitleList
Materials Research Database

Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ Open Access Full Text
  url: https://www.doaj.org/
  sourceTypes: Open Website
– sequence: 2
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 2169-3536
EndPage 1
ExternalDocumentID oai_doaj_org_article_842933e27e774987a05571ab5f515264
10_1109_ACCESS_2024_3367775
10440333
Genre orig-research
GroupedDBID 0R~
5VS
6IK
97E
AAJGR
ABAZT
ABVLG
ACGFS
ADBBV
ALMA_UNASSIGNED_HOLDINGS
BCNDV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
EBS
ESBDL
GROUPED_DOAJ
IPLJI
JAVBF
KQ8
M43
M~E
O9-
OCL
OK1
RIA
RIE
RNS
4.4
AAYXX
AGSQL
CITATION
EJD
RIG
7SC
7SP
7SR
8BQ
8FD
JG9
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c359t-2b92841a82b1af480af5b156e90cb61732eb5b4fcb63a92b94feb2aa2c770cb33
IEDL.DBID DOA
ISSN 2169-3536
IngestDate Wed Aug 27 01:24:56 EDT 2025
Mon Jun 30 07:02:29 EDT 2025
Tue Jul 01 04:14:22 EDT 2025
Wed Aug 27 02:09:32 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Language English
License https://creativecommons.org/licenses/by-nc-nd/4.0
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c359t-2b92841a82b1af480af5b156e90cb61732eb5b4fcb63a92b94feb2aa2c770cb33
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0009-0009-5715-5576
0000-0003-3911-725X
OpenAccessLink https://doaj.org/article/842933e27e774987a05571ab5f515264
PQID 2932575480
PQPubID 4845423
PageCount 1
ParticipantIDs doaj_primary_oai_doaj_org_article_842933e27e774987a05571ab5f515264
crossref_primary_10_1109_ACCESS_2024_3367775
ieee_primary_10440333
proquest_journals_2932575480
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2024-01-01
PublicationDateYYYYMMDD 2024-01-01
PublicationDate_xml – month: 01
  year: 2024
  text: 2024-01-01
  day: 01
PublicationDecade 2020
PublicationPlace Piscataway
PublicationPlace_xml – name: Piscataway
PublicationTitle IEEE access
PublicationTitleAbbrev Access
PublicationYear 2024
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref12
ref15
ref14
ref11
ref10
Angrisani (ref47)
ref17
ref16
ref19
Chambino (ref18) 2013
Murphy (ref41) 2021
ref51
ref50
ref46
Butterworth (ref36) 1930; 7
Guinón (ref45)
ref48
ref42
ref44
ref43
ref49
ref7
ref9
ref4
ref3
ref6
ref5
ref40
ref35
ref34
ref37
ref31
ref30
ref33
ref32
ref2
ref1
ref39
ref38
ref24
ref23
ref26
ref25
ref20
ref22
ref21
Lewandowska (ref8)
ref28
ref27
ref29
References_xml – start-page: 1116
  volume-title: Proc. 20th IMEKO TC4
  ident: ref47
  article-title: The effect of Savitzky–Golay smoothing filter on the performance of a vehicular dynamic spectrum access method
– ident: ref9
  doi: 10.1109/tbme.2010.2086456
– ident: ref17
  doi: 10.1109/access.2017.2678521
– ident: ref14
  doi: 10.1016/0165-1684(94)90029-9
– ident: ref38
  doi: 10.1109/taffc.2021.3056960
– ident: ref23
  doi: 10.1080/00015550310015419
– ident: ref34
  doi: 10.1111/sms.12604
– ident: ref2
  doi: 10.1088/0967-3334/37/5/n27
– ident: ref51
  doi: 10.1186/1475-2840-8-55
– start-page: 405
  volume-title: Proc. Federated Conf. Comput. Sci. Inf. Syst. (FedCSIS)
  ident: ref8
  article-title: Measuring pulse rate with a webcam—A non-contact method for evaluating cardiac activity
– ident: ref29
  doi: 10.1109/bhi.2016.7455830
– ident: ref19
  doi: 10.1016/j.earlhumdev.2013.09.016
– ident: ref26
  doi: 10.1109/memea.2014.6860029
– ident: ref25
  doi: 10.1111/srt.12020
– ident: ref4
  doi: 10.3390/app9204474
– ident: ref30
  doi: 10.1080/21681163.2018.1441075
– ident: ref21
  doi: 10.1038/s41746-019-0199-5
– ident: ref35
  doi: 10.1021/ac60214a047
– ident: ref46
  doi: 10.1016/j.pisc.2016.06.056
– ident: ref42
  doi: 10.1109/jcsse.2016.7748888
– ident: ref28
  doi: 10.1109/memea.2016.7533818
– ident: ref1
  doi: 10.1371/journal.pone.0071384
– ident: ref16
  doi: 10.1145/2683405.2683446
– ident: ref6
  doi: 10.1088/0967-3334/28/3/r01
– ident: ref33
  doi: 10.1152/japplphysiol.01281.2006
– ident: ref7
  doi: 10.1063/1.2724789
– ident: ref13
  doi: 10.1371/journal.pone.0202581
– ident: ref11
  doi: 10.1109/tbme.2013.2266196
– ident: ref44
  doi: 10.1109/icce.2019.8661915
– ident: ref43
  doi: 10.1162/089976699300016863
– ident: ref31
  doi: 10.4103/tjps.tjps_2_17
– ident: ref32
  doi: 10.3758/s13428-019-01256-8
– ident: ref37
  doi: 10.1001/archderm.124.6.869
– year: 2021
  ident: ref41
  publication-title: Pulse Sensor Amped Processing Visualizer
– ident: ref10
  doi: 10.1145/2185520.2185561
– ident: ref20
  doi: 10.1049/htl.2014.0077
– ident: ref12
  doi: 10.1109/tbme.2014.2356291
– ident: ref27
  doi: 10.1109/mva.2015.7153099
– ident: ref48
  doi: 10.1364/oe.18.010762
– start-page: 1
  volume-title: Proc. Int. Conf. Eng. Educ.
  ident: ref45
  article-title: Moving average and Savitzki–Golay smoothing filters using Mathcad
– volume: 7
  start-page: 536
  year: 1930
  ident: ref36
  article-title: On the theory of filter amplifiers
  publication-title: Exp.WirelessWireless Eng.
– ident: ref5
  doi: 10.1007/s10439-005-5763-2
– year: 2013
  ident: ref18
  article-title: Android-based implementation of Eulerian video magnification for vital signs monitoring
– ident: ref39
  doi: 10.1109/iementech.2018.8465225
– ident: ref22
  doi: 10.1007/s00276-002-0034-5
– ident: ref40
  doi: 10.1109/10.979357
– ident: ref49
  doi: 10.1016/j.ijms.2013.01.003
– ident: ref15
  doi: 10.1109/tbme.2014.2323695
– ident: ref3
  doi: 10.1109/access.2017.2735419
– ident: ref50
  doi: 10.1093/oxfordjournals.aje.a009901
– ident: ref24
  doi: 10.1109/cvpr.2013.440
SSID ssj0000816957
Score 2.3002102
Snippet Color fluctuations caused by blood perfusion on the skin are an essential tool for the success of imaging photoplethysmography (iPPG) methods. However, color...
SourceID doaj
proquest
crossref
ieee
SourceType Open Website
Aggregation Database
Index Database
Publisher
StartPage 1
SubjectTerms Biomedical monitoring
Blood
Color
Electron tubes
Fast Fourier transformations
FFT
Fitzpatrick standard
Fluorescence
Fourier transforms
Heart rate
Image color analysis
Independent component analysis
iPPG
Light
Light sources
Methods
Monitoring
non-facial pulse measurement
Principal component analysis
Pulse measurements
Skin
Tubes
Videos
Wrist
SummonAdditionalLinks – databaseName: IEEE/IET Electronic Library
  dbid: RIE
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Lb9QwELZoT3DgWcRCQT5wxEsS2xv7uF1RVaisUEtRb5btjFFVKUHd5AB_gr_MjJNdrUBI3PKwE0fjxzeTz98w9jYaWWqQQaTGK6FMo4VFWCRUVIvoPYU-MkF2vTi7Uh-v9fW0WT3vhQGATD6DOR3mf_lNFwcKleEIV6qQUh6wA-xn42atXUCFMkhYXU_KQmVh3y9XK_wI9AErNZdyUddEJtxbfbJI_5RV5a-pOK8vp4_YetuykVZyOx_6MI8__xBt_O-mP2YPJ6TJl2PXeMLuQfuUPdjTH3zGfl10Ydj0_FNOI80Rv_J11wpSrPKx518poQi_vPnWYoldKJHftHingW7Dl5F4xNDQpQtEnCJTc_g5Ofz8EjKlesNpBwunJF_8HKdVvswMEqwUfvATos3zz3CXBoraHbGr0w9fVmdiytAgotS2F1WwuLyV3lSh9EmZwicd0CMEW8SA2EhWEHRQCU-kt1haJfTkva9iXWMJKZ-zw7Zr4QXjqpHJSqtTMggiKzCqSTaVxqYCIs4TM_Zuazn3fRTicNmBKawbDe3I0G4y9IydkHV3RUlFO19Aq7hpUDqDi7GUUNWAINia2pMgWemDTojyECnO2BFZcu99oxFn7HjbWdw05DcOH4XTH8nnvfxHtVfsfkXZg0kpcnHMDvu7AV4jpOnDm9yVfwP5FPM3
  priority: 102
  providerName: IEEE
Title Robust Method for Non-Contact Vital Sign Measurement in Videos Acquired in Real-World Light Settings from Skin Less Affected by Blood Perfusion
URI https://ieeexplore.ieee.org/document/10440333
https://www.proquest.com/docview/2932575480
https://doaj.org/article/842933e27e774987a05571ab5f515264
Volume 12
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1LT9wwELYQp3JAfVCxLUVz4IhLEtsb-7isukKIIgSl4mbZjl1xaIJ2s4f-iv7lzjgBReqhlx7jTOLYM56XJt8wdhK0KFUUnqfGSS51o7hBt4jLIOfBOUp95ALZ6_nFvbx8UA-TVl9UEzbAAw8bd6ZRYQoRqzqio4IBsiPQqNJ5ldASozUn7VuYYhJMZR2sy7lR9QgzVBbmbLFc4oowIKzkZyHmdU2VhRNTlBH7xxYrf-nlbGxWr9n-6CXCYvi6N2wntm_Z3gQ78B37fdv57aaHr7kFNKDvCdddywltyoUevlMzELh7_NEixUsaEB5bvNPEbgOLQDXAsaGhW_QWeS6rgSsK1uEu5nLoDazW3U-gBl1whSoRFrn6Ax_yv-CcSt7hJq7TljJuB-x-9eXb8oKP3RV4EMr0vPIGTVPpdOVLl6QuXFIeo7loiuDRrxFV9MrLhBfCGaSWCaNw56pQ10ghxHu223ZtPGQgG5GMMColjQ5gFbVskkmlNqmIAc_4jJ0-b7R9GkA0bA4-CmMHvljiix35MmPnxIwXUkLAzgMoF3aUC_svuZixA2LlZD4pCyHEjB0989aOx3Vj8VWougj67sP_mPsje0XrGTI1R2y3X2_jJ_Rden-cxfQ4_2b4B7AS6B4
linkProvider Directory of Open Access Journals
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3Pb9MwFLZgHIAD48cQhQ184IhLEtuNfeyqTQW6Cu0H2s2yHXuakJJpTQ7jn-Bf5j0nrSrQJG5tYjeunu33vZfP3yPko1c8l4E7FisrmFCVZBpgERNeTLy1mPpIBNnlZH4hvl7Ky-GwejoLE0JI5LMwxo_pXX7V-A5TZbDChcg45w_JI3D8QvbHtTYpFawhoWU5aAvlmf48nc3gb0AUWIgx55OyRDrhlv9JMv1DXZV_NuPkYY53yXI9tp5Y8nPctW7sf_0l2_jfg39Ong1Yk077yfGCPAj1S_J0S4HwFfl92rhu1dKTVEiaAoKly6ZmqFllfUt_YEkRenZ9VUOLTTKRXtdwpwrNik49MolDhZdOAXOyRM6hCwz56VlIpOoVxTMsFMt80QVsrHSaOCTQyd3RQyTO0-_hNnaYt9sjF8dH57M5G2o0MM-lblnhNDi43KrC5TYKldkoHcSEQWfeATriRXDSiQhfuNXQWkSI5a0tfFlCC85fk526qcMbQkXFo-ZaxqgARhZBiSrqmCsds-BhpxiRT2vLmZteisOkECbTpje0QUObwdAjcojW3TRFHe10AaxihmVpFLhjzkNRBoDBWpUWJcly62QEnAdYcUT20JJbz-uNOCL768lihkW_MvBTsAGigN7be7p9II_n5ycLs_iy_PaOPMHh9umcfbLT3nbhAABO696naf0H1bv2eg
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Robust+Method+for+Non-Contact+Vital+Sign+Measurement+in+Videos+Acquired+in+Real-World+Light+Settings+From+Skin+Less+Affected+by+Blood+Perfusion&rft.jtitle=IEEE+access&rft.au=Nattapong+Tangjui&rft.au=Pinyo+Taeprasartsit&rft.date=2024-01-01&rft.pub=IEEE&rft.eissn=2169-3536&rft.volume=12&rft.spage=28582&rft.epage=28597&rft_id=info:doi/10.1109%2FACCESS.2024.3367775&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_842933e27e774987a05571ab5f515264
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2169-3536&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2169-3536&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2169-3536&client=summon