Wearable Sensor-Based Hand Gesture and Daily Activity Recognition for Robot-Assisted Living

In this paper, we address natural human-robot interaction (HRI) in a smart assisted living (SAIL) system for the elderly and the disabled. Two common HRI problems are studied: hand gesture recognition and daily activity recognition. For hand gesture recognition, we implemented a neural network for g...

Full description

Saved in:
Bibliographic Details
Published inIEEE transactions on systems, man and cybernetics. Part A, Systems and humans Vol. 41; no. 3; pp. 569 - 573
Main Authors Zhu, Chun, Sheng, Weihua
Format Journal Article
LanguageEnglish
Published IEEE 01.05.2011
Subjects
Online AccessGet full text

Cover

Loading…
Abstract In this paper, we address natural human-robot interaction (HRI) in a smart assisted living (SAIL) system for the elderly and the disabled. Two common HRI problems are studied: hand gesture recognition and daily activity recognition. For hand gesture recognition, we implemented a neural network for gesture spotting and a hierarchical hidden Markov model for context-based recognition. For daily activity recognition, a multisensor fusion scheme is developed to process motion data collected from the foot and the waist of a human subject. Experiments using a prototype wearable sensor system show the effectiveness and accuracy of our algorithms.
AbstractList In this paper, we address natural human-robot interaction (HRI) in a smart assisted living (SAIL) system for the elderly and the disabled. Two common HRI problems are studied: hand gesture recognition and daily activity recognition. For hand gesture recognition, we implemented a neural network for gesture spotting and a hierarchical hidden Markov model for context-based recognition. For daily activity recognition, a multisensor fusion scheme is developed to process motion data collected from the foot and the waist of a human subject. Experiments using a prototype wearable sensor system show the effectiveness and accuracy of our algorithms.
Author Chun Zhu
Weihua Sheng
Author_xml – sequence: 1
  givenname: Chun
  surname: Zhu
  fullname: Zhu, Chun
– sequence: 2
  givenname: Weihua
  surname: Sheng
  fullname: Sheng, Weihua
BookMark eNp9kU1PwzAMhiMEEtvgD8ClN04d-Wja9DgGbEhDSNsQBw5VkrlTUNeMJEPavydlEwcOnGzL72PZr_votLUtIHRF8JAQXN4uF8_j0ZDiWFNcMiHYCeoRzkVKM5qfxhwLlmYZLc5R3_sPjEmWlVkPvb-BdFI1kCyg9dald9LDKpnKdpVMwIedg6TL76Vp9slIB_Nlwj6Zg7br1gRj26S2LplbZUM68t74EPFZVLXrC3RWy8bD5TEO0Ovjw3I8TWcvk6fxaJZqVtKQSoWLbEU5xVpxCopLJfO4XYFrVgqWa1JrXXMBtcwLKJWKTUYkrZVW2QpLNkA3h7lbZz93celqY7yGppEt2J2vRMExKwnjUSkOSu2s9w7qSpsguyuCiwdWBFedndWPnVVnZ3W0M6L0D7p1ZiPd_n_o-gAZAPgFeC7iVwj7BrKkg-8
CODEN ITSHFX
CitedBy_id crossref_primary_10_1088_1742_6596_2816_1_012089
crossref_primary_10_1016_j_robot_2018_04_011
crossref_primary_10_3390_s17061229
crossref_primary_10_1007_s41870_021_00831_7
crossref_primary_10_1109_JSEN_2016_2581023
crossref_primary_10_3390_s131114918
crossref_primary_10_1109_JSEN_2021_3075151
crossref_primary_10_1109_MSMC_2018_2822846
crossref_primary_10_1109_JSEN_2015_2392091
crossref_primary_10_1177_0954406220931547
crossref_primary_10_3390_app12157410
crossref_primary_10_1109_JSEN_2023_3282171
crossref_primary_10_3390_s19173808
crossref_primary_10_1109_THMS_2012_2234371
crossref_primary_10_1109_ACCESS_2020_2973305
crossref_primary_10_1038_s41597_021_00876_0
crossref_primary_10_1109_ACCESS_2021_3077487
crossref_primary_10_1007_s11517_019_02076_w
crossref_primary_10_1109_JLT_2023_3327046
crossref_primary_10_1109_TMAG_2019_2896036
crossref_primary_10_1111_coin_12699
crossref_primary_10_1177_1550147719853987
crossref_primary_10_1016_j_jvcir_2013_03_017
crossref_primary_10_1109_TMC_2021_3120475
crossref_primary_10_1109_JSEN_2022_3233653
crossref_primary_10_1109_THMS_2020_3043302
crossref_primary_10_1109_TSMCA_2011_2116004
crossref_primary_10_1145_3705893
crossref_primary_10_3390_app11052015
crossref_primary_10_3233_JIFS_235132
crossref_primary_10_3390_electronics9091357
crossref_primary_10_1109_TSMC_2013_2281586
crossref_primary_10_1155_2016_3692876
crossref_primary_10_1016_j_robot_2022_104353
crossref_primary_10_1109_TITB_2012_2226905
crossref_primary_10_4316_AECE_2022_04010
crossref_primary_10_1109_JSEN_2016_2628346
crossref_primary_10_3390_s20247161
crossref_primary_10_1109_TSMC_2013_2256857
crossref_primary_10_1088_2631_8695_ad5bc0
crossref_primary_10_3390_s21175743
crossref_primary_10_1080_1206212X_2024_2426501
crossref_primary_10_1109_TNNLS_2023_3344294
crossref_primary_10_1109_TSMC_2020_3009669
crossref_primary_10_1007_s00521_021_06795_w
crossref_primary_10_1109_TSMC_2013_2291714
crossref_primary_10_3390_s21248469
crossref_primary_10_1016_j_eswa_2022_119042
crossref_primary_10_1109_TSMC_2013_2296569
crossref_primary_10_1007_s11370_016_0208_3
crossref_primary_10_1109_TMECH_2011_2160354
crossref_primary_10_1109_TCYB_2020_3041033
crossref_primary_10_1109_LSENS_2018_2864963
crossref_primary_10_5772_60077
crossref_primary_10_1109_ACCESS_2020_2982225
crossref_primary_10_3390_s17122900
crossref_primary_10_1177_0954411920953031
crossref_primary_10_1007_s11370_023_00466_6
crossref_primary_10_1109_TASE_2019_2945607
crossref_primary_10_1109_JSEN_2022_3208271
crossref_primary_10_1109_TCSVT_2019_2912988
crossref_primary_10_1016_j_eswa_2012_08_066
crossref_primary_10_1108_AA_11_2018_0228
crossref_primary_10_1109_ACCESS_2020_2994281
crossref_primary_10_1109_JSEN_2018_2880194
crossref_primary_10_1109_JERM_2019_2949456
crossref_primary_10_3390_s16050605
crossref_primary_10_1016_j_nanoen_2024_110425
crossref_primary_10_1155_2018_9032945
crossref_primary_10_1016_j_measurement_2022_110850
crossref_primary_10_1109_TCDS_2018_2844279
crossref_primary_10_1109_THMS_2014_2302794
crossref_primary_10_1088_1361_6501_ab63ea
crossref_primary_10_1016_j_compbiomed_2022_105458
crossref_primary_10_1007_s40860_016_0028_4
crossref_primary_10_1145_3568671
crossref_primary_10_1364_AOP_390929
crossref_primary_10_1109_ACCESS_2018_2810951
crossref_primary_10_1016_j_inffus_2017_08_002
crossref_primary_10_2139_ssrn_3986704
crossref_primary_10_1109_JSEN_2019_2946095
crossref_primary_10_3390_rs13214264
crossref_primary_10_1016_j_measurement_2023_113231
crossref_primary_10_1016_j_jnca_2020_102738
crossref_primary_10_1541_ieejeiss_135_637
crossref_primary_10_1109_TSMCC_2012_2215852
crossref_primary_10_1016_j_ijhcs_2019_03_011
crossref_primary_10_1109_TIM_2019_2909249
crossref_primary_10_1007_s11063_019_10008_w
crossref_primary_10_1109_TIM_2022_3164162
crossref_primary_10_1016_j_future_2016_03_016
crossref_primary_10_1016_j_promfg_2020_01_288
crossref_primary_10_1109_TIE_2015_2497662
crossref_primary_10_1109_TII_2017_2779814
crossref_primary_10_1109_ACCESS_2024_3395173
crossref_primary_10_1186_s12984_023_01274_w
crossref_primary_10_1016_j_enbuild_2023_113808
crossref_primary_10_1109_JBHI_2014_2329137
crossref_primary_10_5772_56617
crossref_primary_10_1109_TPWRD_2019_2900543
crossref_primary_10_1177_1550147716665520
crossref_primary_10_1007_s11042_020_08902_w
crossref_primary_10_1109_THMS_2014_2354046
crossref_primary_10_1109_JSEN_2016_2546942
Cites_doi 10.1111/j.2517-6161.1977.tb01600.x
10.1109/34.799904
10.1093/comjnl/41.8.559
10.1109/3468.553220
10.1109/5.18626
10.1109/ICSMC.2004.1400763
10.1109/TSMCA.2005.851332
10.1109/TIT.1967.1054010
10.1109/TSMCA.2002.804821
10.1016/S0031-3203(03)00042-6
10.1109/TSMCA.2009.2033031
10.1109/TBME.2003.812189
ContentType Journal Article
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
7SP
7TB
8FD
F28
FR3
JQ2
L7M
L~C
L~D
DOI 10.1109/TSMCA.2010.2093883
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005-present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Mechanical & Transportation Engineering Abstracts
Technology Research Database
ANTE: Abstracts in New Technology & Engineering
Engineering Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Mechanical & Transportation Engineering Abstracts
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Engineering Research Database
Advanced Technologies Database with Aerospace
ANTE: Abstracts in New Technology & Engineering
Computer and Information Systems Abstracts Professional
DatabaseTitleList Technology Research Database

Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
Sciences (General)
EISSN 1558-2426
EndPage 573
ExternalDocumentID 10_1109_TSMCA_2010_2093883
5682421
Genre orig-research
GroupedDBID -~X
0R~
29I
4.4
5VS
6IK
85S
97E
AAJGR
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFS
AETIX
AGQYO
AGSQL
AHBIQ
AI.
AIBXA
ALLEH
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
EBS
EJD
F5P
HZ~
IFIPE
IFJZH
IPLJI
JAVBF
LAI
M43
O9-
OCL
PZZ
RIA
RIE
RNS
VH1
VJK
AAYOK
AAYXX
CITATION
7SC
7SP
7TB
8FD
F28
FR3
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c392t-ab074d2520cb52eb5aba644970f39836c1fccf58efa67e9bb64431a2fbcb4d0a3
IEDL.DBID RIE
ISSN 1083-4427
IngestDate Fri Jul 11 08:47:55 EDT 2025
Tue Jul 01 05:27:30 EDT 2025
Thu Apr 24 22:57:07 EDT 2025
Tue Aug 26 17:18:00 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 3
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c392t-ab074d2520cb52eb5aba644970f39836c1fccf58efa67e9bb64431a2fbcb4d0a3
Notes ObjectType-Article-2
SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 23
PQID 875039135
PQPubID 23500
PageCount 5
ParticipantIDs crossref_primary_10_1109_TSMCA_2010_2093883
ieee_primary_5682421
crossref_citationtrail_10_1109_TSMCA_2010_2093883
proquest_miscellaneous_875039135
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2011-May
2011-05-00
20110501
PublicationDateYYYYMMDD 2011-05-01
PublicationDate_xml – month: 05
  year: 2011
  text: 2011-May
PublicationDecade 2010
PublicationTitle IEEE transactions on systems, man and cybernetics. Part A, Systems and humans
PublicationTitleAbbrev TSMCA
PublicationYear 2011
Publisher IEEE
Publisher_xml – name: IEEE
References ref12
ref14
ref11
ref10
zhu (ref18) 2009
lester (ref13) 2005
dempster (ref15) 1977; 39
ref16
ref8
ref7
ref9
ref4
zhu (ref3) 2008
haigh (ref1) 2002
ref6
(ref17) 2009
ref5
zhu (ref2) 2008
References_xml – start-page: 954
  year: 2008
  ident: ref2
  article-title: Wearable sensors based human intention recognition in smart assisted living systems
  publication-title: Proc IEEE Int Conf Des Autom
– start-page: 39
  year: 2002
  ident: ref1
  article-title: Automation as caregiver: A survey of issues and technologies
  publication-title: Proc AAAI Workshop Automation as Caregiver
– start-page: 766
  year: 2005
  ident: ref13
  article-title: A hybrid discriminative/generative approach for modeling human activities
  publication-title: Proc IJCAI
– volume: 39
  start-page: 1
  year: 1977
  ident: ref15
  article-title: Maximum likelihood from incomplete data via the EM algorithm
  publication-title: J R Stat Soc
  doi: 10.1111/j.2517-6161.1977.tb01600.x
– ident: ref14
  doi: 10.1109/34.799904
– ident: ref7
  doi: 10.1093/comjnl/41.8.559
– ident: ref12
  doi: 10.1109/3468.553220
– ident: ref9
  doi: 10.1109/5.18626
– ident: ref4
  doi: 10.1109/ICSMC.2004.1400763
– ident: ref11
  doi: 10.1109/TSMCA.2005.851332
– ident: ref16
  doi: 10.1109/TIT.1967.1054010
– ident: ref5
  doi: 10.1109/TSMCA.2002.804821
– ident: ref8
  doi: 10.1016/S0031-3203(03)00042-6
– ident: ref6
  doi: 10.1109/TSMCA.2009.2033031
– start-page: 253
  year: 2008
  ident: ref3
  article-title: Human intention recognition in smart assisted living systems using a hierarchical hidden Markov model
  publication-title: Proc IEEE Int Conf Autom Sci Eng
– ident: ref10
  doi: 10.1109/TBME.2003.812189
– year: 2009
  ident: ref18
  publication-title: Hand Gesture Recognition for Human Robot Interaction (HRI)
– year: 2009
  ident: ref17
  publication-title: LLC MEMSense
SSID ssj0014494
Score 2.4184558
Snippet In this paper, we address natural human-robot interaction (HRI) in a smart assisted living (SAIL) system for the elderly and the disabled. Two common HRI...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 569
SubjectTerms Accuracy
Algorithms
Artificial neural networks
Assisted living
Cybernetics
Gesture recognition
Hidden Markov models
hidden Markov models (HMNs)
Human
human-robot interaction (HRI)
Humans
Mathematical models
Multisensor fusion
Neural networks
Recognition
Robots
Sensors
Wearable
wearable computing
Title Wearable Sensor-Based Hand Gesture and Daily Activity Recognition for Robot-Assisted Living
URI https://ieeexplore.ieee.org/document/5682421
https://www.proquest.com/docview/875039135
Volume 41
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Lb9QwEB61PZUD9AFigSIfegCVbJM4D-e4lLarinLoQ1TiEHnsiVS1StA2OcCvZ-wkKwpV1Zsl25Klb-z5xvMC2K2qIkfDZkmYWwoSVkmBylLD9yqxJJFUTD7a4ls2v0xOrtKrFfi0zIUhIh98RlM39L5825jOfZXtp5lyHsxVWGXDrc_VWnoMksQ3PYyYUgRJEudjgkxY7F-cnx7M-iiumA14peQ9JeS7qvz3FHv9cvQCTseT9WElN9Ouxan5_U_RxqcefQOeD0RTzHrJ2IQVqrfg2V_lB7dgc7jYd-LDUH364zb8-M6y7_KpxDlbuM0i-Mx6zoq5rq045nN3CxJu_EVf3_4SM9N3nxBnYyBSUwvmweKswaYNGHwnRlZ8vXYfFy_h8ujw4mAeDB0YAsO8qQ00MsOwcRqHBtOYMNWomUAVeVjJQsnMRJUxVaqo0llOBSJPykjHFRpMbKjlK1irm5peg8BMo7SamOAxiYmURsIQpawKfmWsVROIRkhKM5Qnd10ybktvpoRF6WEsHYzlAOME9pZ7fvbFOR5dve1wWa4cIJmAGJEv-Wo5f4muqenuSuV8vEUk0zcP73wL6_0Pswt_fAdr7aKjHaYoLb73svkH0S7ihg
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Lb9QwEB6VcgAOQFsQy9MHDiDINonjxDkuhbLAbg_tVlTqIfLYE6miStA2OcCvZ5zHipcQN0u2JUvf2PON5wXwvCzzDC2bJWHmKEhYJQU6VZbvVeJIIumYumiLo3R-mnw8U2db8HqTC0NEXfAZTf2w8-W72rb-q2xfpdp7MK_Bddb7KuqztTY-gyTp2h5GTCqCJImzMUUmzPdXJ8uDWR_HFbMJr7X8RQ11fVX-eIw7DXN4B5bj2frAki_TtsGp_f5b2cb_PfxduD1QTTHrZWMHtqjahVs_FSDchZ3hal-JF0P96Zd7cP6Zpd9nVIkTtnHrdfCGNZ0Tc1M58Z7P3a5J-PFbc3H5Tcxs339CHI-hSHUlmAmL4xrrJmD4vSA5sbjwXxf34PTw3epgHgw9GALLzKkJDDLHcLGKQ4sqJlQGDVOoPAtLmWuZ2qi0tlSaSpNmlCPypIxMXKLFxIVG3oftqq7oAQhMDUpniCke05hIGyQMUcoy53fGOT2BaISksEOBct8n47LoDJUwLzoYCw9jMcA4gVebPV_78hz_XL3ncdmsHCCZgBiRL_hyeY-Jqahurwrtvbx5JNXDv-98Bjfmq-WiWHw4-vQIbvb_zT4Y8jFsN-uWnjBhafBpJ6c_AMmk5c8
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Wearable+Sensor-Based+Hand+Gesture+and+Daily+Activity+Recognition+for+Robot-Assisted+Living&rft.jtitle=IEEE+transactions+on+systems%2C+man+and+cybernetics.+Part+A%2C+Systems+and+humans&rft.au=Zhu%2C+Chun&rft.au=Sheng%2C+Weihua&rft.date=2011-05-01&rft.issn=1083-4427&rft.eissn=1558-2426&rft.volume=41&rft.issue=3&rft.spage=569&rft.epage=573&rft_id=info:doi/10.1109%2FTSMCA.2010.2093883&rft.externalDBID=n%2Fa&rft.externalDocID=10_1109_TSMCA_2010_2093883
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1083-4427&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1083-4427&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1083-4427&client=summon