Gesture Interface and Transfer Method for AMR by Using Recognition of Pointing Direction and Object Recognition

This paper describes a gesture interface for a factory transfer robot. Our proposed interface used gesture recognition to recognize the pointing direction, instead of estimating the point as in conventional pointing gesture estimation. When the autonomous mobile robot (AMR) recognized the pointing d...

Full description

Saved in:
Bibliographic Details
Published inJournal of robotics and mechatronics Vol. 35; no. 2; pp. 288 - 297
Main Authors Ikeda, Takahiro, Noda, Naoki, Ueki, Satoshi, Yamada, Hironao
Format Journal Article
LanguageEnglish
Published Tokyo Fuji Technology Press Co. Ltd 20.04.2023
Subjects
Aerospace industry
Angular position
Automation
Cameras
Estimation
Factories
Gesture recognition
Interfaces
Magnetic tape
Manufacturing
Object recognition
Robots
Voice recognition
Workers
Online AccessGet full text

Cover

Abstract This paper describes a gesture interface for a factory transfer robot. Our proposed interface used gesture recognition to recognize the pointing direction, instead of estimating the point as in conventional pointing gesture estimation. When the autonomous mobile robot (AMR) recognized the pointing direction, it performed position control based on the object recognition. The AMR traveled along our unique path to ensure that its camera detected the object to be referenced for position control. The experimental results confirmed that the position and angular errors of the AMR controlled with our interface were 0.058 m and 4.7° averaged over five subjects and two conditions, which were sufficiently accurate for transportation. A questionnaire showed that our interface was user-friendly compared with manual operation with a commercially available controller.
AbstractList This paper describes a gesture interface for a factory transfer robot. Our proposed interface used gesture recognition to recognize the pointing direction, instead of estimating the point as in conventional pointing gesture estimation. When the autonomous mobile robot (AMR) recognized the pointing direction, it performed position control based on the object recognition. The AMR traveled along our unique path to ensure that its camera detected the object to be referenced for position control. The experimental results confirmed that the position and angular errors of the AMR controlled with our interface were 0.058 m and 4.7° averaged over five subjects and two conditions, which were sufficiently accurate for transportation. A questionnaire showed that our interface was user-friendly compared with manual operation with a commercially available controller.
Author Ikeda, Takahiro
Ueki, Satoshi
Noda, Naoki
Yamada, Hironao
Author_xml – sequence: 1
  givenname: Takahiro
  orcidid: 0000-0003-4420-7778
  surname: Ikeda
  fullname: Ikeda, Takahiro
  organization: Faculty of Engineering, Gifu University, 1-1 Yanagido, Gifu 501-1193, Japan
– sequence: 2
  givenname: Naoki
  surname: Noda
  fullname: Noda, Naoki
  organization: Faculty of Engineering, Gifu University, 1-1 Yanagido, Gifu 501-1193, Japan
– sequence: 3
  givenname: Satoshi
  surname: Ueki
  fullname: Ueki, Satoshi
  organization: Faculty of Engineering, Gifu University, 1-1 Yanagido, Gifu 501-1193, Japan
– sequence: 4
  givenname: Hironao
  surname: Yamada
  fullname: Yamada, Hironao
  organization: Faculty of Engineering, Gifu University, 1-1 Yanagido, Gifu 501-1193, Japan
BookMark eNp1kE1PAjEQhhuDiYicvTbxvNCP3e72SFCRRIIhcG7abosl0GJ3OfDv7YIHY-Jc5iPvO5N57kHPB28AeMRoRBBnxXgXD6kidHREpKpuQB9XFc0qlPMe6COOi4zynNyBYdPsUIoiLzkt-yDMTNOeooFz35popTZQ-hquo_SNNREuTPsZamhDhJPFCqoz3DTOb-HK6LD1rnXBw2DhR3C-7ebPLhp9mXZrlmqXut_iB3Br5b4xw588AJvXl_X0LXtfzubTyXumc4bajBldkrqWueGkyo1kltbWFExLhbhSiqmSIVUxZjExiFqCOauxRgWWeWElogPwdN17jOHrlH4Uu3CKPp0UpEqIOEacJtX4qtIxNE00VhyjO8h4FhiJC1iRwIoOrLiATY7ij0O7VnaftVG6_b--b5NogK0
CitedBy_id crossref_primary_10_1061_JCCEE5_CPENG_5715
Cites_doi 10.1109/FUZZY.2011.6007673
10.20965/jrm.2010.p0430
10.7210/jrsj.24.964
10.20965/jaciii.2011.p0869
10.1007/s12369-017-0408-9
10.1007/s43154-020-00005-6
10.20965/jaciii.2017.p0709
10.20965/jrm.2008.p0515
10.1016/j.ergon.2017.02.004
10.1109/CVPR.2017.143
10.1109/CVPR.2017.690
10.1007/978-3-030-50726-8_27
10.1561/9781601980939
10.37917/ijeee.16.2.10
ContentType Journal Article
Copyright Copyright © 2023 Fuji Technology Press Ltd.
Copyright_xml – notice: Copyright © 2023 Fuji Technology Press Ltd.
DBID AAYXX
CITATION
7SC
7SP
8FD
8FE
8FG
AFKRA
ARAPS
AZQEC
BENPR
BGLVJ
CCPQU
DWQXO
GNUQQ
HCIFZ
JQ2
K7-
L7M
L~C
L~D
P5Z
P62
PHGZM
PHGZT
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
DOI 10.20965/jrm.2023.p0288
DatabaseName CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Technology Research Database
ProQuest SciTech Collection
ProQuest Technology Collection
ProQuest Central UK/Ireland
Advanced Technologies & Aerospace Collection
ProQuest Central Essentials
ProQuest Central
Technology Collection
ProQuest One
ProQuest Central Korea
ProQuest Central Student
SciTech Premium Collection
ProQuest Computer Science Collection
Computer Science Database
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
Advanced Technologies & Aerospace Database
ProQuest Advanced Technologies & Aerospace Collection
ProQuest Central Premium
ProQuest One Academic (New)
ProQuest One Academic Middle East (New)
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Applied & Life Sciences
ProQuest One Academic
ProQuest One Academic UKI Edition
ProQuest Central China
DatabaseTitle CrossRef
Computer Science Database
ProQuest Central Student
Technology Collection
Technology Research Database
Computer and Information Systems Abstracts – Academic
ProQuest One Academic Middle East (New)
ProQuest Advanced Technologies & Aerospace Collection
ProQuest Central Essentials
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
SciTech Premium Collection
ProQuest One Community College
ProQuest Central China
ProQuest Central
ProQuest One Applied & Life Sciences
ProQuest Central Korea
ProQuest Central (New)
Advanced Technologies Database with Aerospace
Advanced Technologies & Aerospace Collection
ProQuest One Academic Eastern Edition
Electronics & Communications Abstracts
ProQuest Technology Collection
ProQuest SciTech Collection
Computer and Information Systems Abstracts Professional
Advanced Technologies & Aerospace Database
ProQuest One Academic UKI Edition
ProQuest One Academic
ProQuest One Academic (New)
DatabaseTitleList CrossRef
Computer Science Database
Database_xml – sequence: 1
  dbid: 8FG
  name: ProQuest Technology Collection
  url: https://search.proquest.com/technologycollection1
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 1883-8049
EndPage 297
ExternalDocumentID 10_20965_jrm_2023_p0288
GroupedDBID 7.U
AAYXX
AFKRA
ALMA_UNASSIGNED_HOLDINGS
ARAPS
BENPR
BGLVJ
CCPQU
CITATION
EBS
EJD
GROUPED_DOAJ
HCIFZ
JSF
JSH
K7-
OK1
P2P
PHGZM
PHGZT
RJT
RZJ
7SC
7SP
8FD
8FE
8FG
AZQEC
DWQXO
GNUQQ
JQ2
L7M
L~C
L~D
P62
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
ID FETCH-LOGICAL-c460t-6ec72dda4e9284ea6f3dfe56cab09bbb6b760b866f12e03f2196d1c051a45fa03
IEDL.DBID BENPR
ISSN 0915-3942
IngestDate Fri Jul 25 05:11:26 EDT 2025
Thu Apr 24 22:59:36 EDT 2025
Tue Jul 01 04:15:18 EDT 2025
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 2
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c460t-6ec72dda4e9284ea6f3dfe56cab09bbb6b760b866f12e03f2196d1c051a45fa03
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0003-4420-7778
OpenAccessLink https://doi.org/10.20965/jrm.2023.p0288
PQID 2802891093
PQPubID 4911629
PageCount 10
ParticipantIDs proquest_journals_2802891093
crossref_primary_10_20965_jrm_2023_p0288
crossref_citationtrail_10_20965_jrm_2023_p0288
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2023-04-20
PublicationDateYYYYMMDD 2023-04-20
PublicationDate_xml – month: 04
  year: 2023
  text: 2023-04-20
  day: 20
PublicationDecade 2020
PublicationPlace Tokyo
PublicationPlace_xml – name: Tokyo
PublicationTitle Journal of robotics and mechatronics
PublicationYear 2023
Publisher Fuji Technology Press Co. Ltd
Publisher_xml – name: Fuji Technology Press Co. Ltd
References key-10.20965/jrm.2023.p0288-16
key-10.20965/jrm.2023.p0288-1
key-10.20965/jrm.2023.p0288-2
key-10.20965/jrm.2023.p0288-7
key-10.20965/jrm.2023.p0288-8
key-10.20965/jrm.2023.p0288-9
key-10.20965/jrm.2023.p0288-10
key-10.20965/jrm.2023.p0288-11
key-10.20965/jrm.2023.p0288-3
key-10.20965/jrm.2023.p0288-12
key-10.20965/jrm.2023.p0288-4
key-10.20965/jrm.2023.p0288-13
key-10.20965/jrm.2023.p0288-5
key-10.20965/jrm.2023.p0288-14
key-10.20965/jrm.2023.p0288-6
key-10.20965/jrm.2023.p0288-15
References_xml – ident: key-10.20965/jrm.2023.p0288-10
  doi: 10.1109/FUZZY.2011.6007673
– ident: key-10.20965/jrm.2023.p0288-8
  doi: 10.20965/jrm.2010.p0430
– ident: key-10.20965/jrm.2023.p0288-3
  doi: 10.7210/jrsj.24.964
– ident: key-10.20965/jrm.2023.p0288-16
– ident: key-10.20965/jrm.2023.p0288-11
  doi: 10.20965/jaciii.2011.p0869
– ident: key-10.20965/jrm.2023.p0288-13
  doi: 10.1007/s12369-017-0408-9
– ident: key-10.20965/jrm.2023.p0288-4
  doi: 10.1007/s43154-020-00005-6
– ident: key-10.20965/jrm.2023.p0288-9
  doi: 10.20965/jaciii.2017.p0709
– ident: key-10.20965/jrm.2023.p0288-2
– ident: key-10.20965/jrm.2023.p0288-7
  doi: 10.20965/jrm.2008.p0515
– ident: key-10.20965/jrm.2023.p0288-5
  doi: 10.1016/j.ergon.2017.02.004
– ident: key-10.20965/jrm.2023.p0288-14
  doi: 10.1109/CVPR.2017.143
– ident: key-10.20965/jrm.2023.p0288-15
  doi: 10.1109/CVPR.2017.690
– ident: key-10.20965/jrm.2023.p0288-12
  doi: 10.1007/978-3-030-50726-8_27
– ident: key-10.20965/jrm.2023.p0288-1
  doi: 10.1561/9781601980939
– ident: key-10.20965/jrm.2023.p0288-6
  doi: 10.37917/ijeee.16.2.10
SSID ssj0000547937
Score 2.2688725
Snippet This paper describes a gesture interface for a factory transfer robot. Our proposed interface used gesture recognition to recognize the pointing direction,...
SourceID proquest
crossref
SourceType Aggregation Database
Enrichment Source
Index Database
StartPage 288
SubjectTerms Aerospace industry
Angular position
Automation
Cameras
Estimation
Factories
Gesture recognition
Interfaces
Magnetic tape
Manufacturing
Object recognition
Robots
Voice recognition
Workers
Title Gesture Interface and Transfer Method for AMR by Using Recognition of Pointing Direction and Object Recognition
URI https://www.proquest.com/docview/2802891093
Volume 35
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3NT8IwFG8ELnowfkYUSQ8evEy2snXbyaDhIyYgIZJwW_qZaMyGAw7-976WgnDQ69q-LK_t--7vIXQHapsHMog8P2HgoFAmPc6jwEuiVGtQFzpk5u3wcEQH0_BlFs1cwG3hyio3MtEKalkIEyNvkcTkxAz40eP8yzNdo0x21bXQqKAaiOAEnK_aU3c0nmyjLGCQGAA4C7gHP9ROQ7LG9yEG9aT1UZrH6ATcSSCe7Kumfcls1U3vBB07OxF31ht7ig5UfoaOdtADz1HRh3WrUmEb1dNMKMxyia320arEQ9scGoNVijvDCebf2NYH4MmmZqjIcaHxuHi33SKwk37w1ZB55SZCszv5Ak173bfngef6J3gipP7So0rEREoWqhSUkGJUt6VWERWMww5xTnlMfZ5QqgOi_LYG4UVlIOCasjDSzG9fompe5OoKYUFjoEMDrZQOY0LTlCUxC4nQVIJNxOroYcO6TDhwcdPj4jMDJ8PyOgNeZ4bXmeV1Hd1vF8zXuBp_T21s9iJzF2yR_R6H6_-Hb9ChIWUSQMRvoOqyXKlbsCOWvIkqSa_fdEemab3xH7ETyf4
linkProvider ProQuest
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwtV1LT9wwEB4BPUAPqC0gKND6QCUugcRxnOSAEGpZlsfSCoHELfgpgaqELosQf4rfyIw34XGgN66xPYrH43nZ_gZgDc22TmySRXGhMECRykZaZ0lUZKX3aC68UPR2eHAs-2fi4Dw7n4CH7i0MXavsdGJQ1LYxlCPf5AWdiRH40fb1v4iqRtHpaldCYywWh-7-DkO2m639X7i-Pzjv7Z7-7EdtVYHICBmPIulMzq1VwpWomp2SPrXeZdIojf-ttdS5jHUhpU-4i1OPW1raxKDwKpF5FadIdxI-iDQtaUcVvb2nnA66PwQ3F-D9cPppKfgYTYgTxsrm1ZCevnMMXnEqxWtD-NoOBOPW-wSzrVfKdsZi9BkmXP0FPr7AKpyDZg_H3Q4dCzlEr4xjqrYs2DrvhmwQSlEz9IHZzuCE6XsWbiOwk-6GUlOzxrM_zWWoTcFaXYtficxvTfmgl53n4exd-LoAU3VTu0VgRuZIRybeOS9yLstSFbkS3Hhp0QNTS7DRsa4yLZQ5VdT4W2FIE3hdIa8r4nUVeL0E608DrscoHm93XenWomq38031LHxf_9_8Hab7p4Oj6mj_-HAZZogsHT3xeAWmRsNbt4oezEh_C2LD4OK95fQRONcE2A
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Gesture+Interface+and+Transfer+Method+for+AMR+by+Using+Recognition+of+Pointing+Direction+and+Object+Recognition&rft.jtitle=Journal+of+robotics+and+mechatronics&rft.au=Ikeda+Takahiro&rft.au=Noda+Naoki&rft.au=Ueki+Satoshi&rft.au=Yamada+Hironao&rft.date=2023-04-20&rft.pub=Fuji+Technology+Press+Co.+Ltd&rft.issn=0915-3942&rft.eissn=1883-8049&rft.volume=35&rft.issue=2&rft.spage=288&rft.epage=297&rft_id=info:doi/10.20965%2Fjrm.2023.p0288
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0915-3942&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0915-3942&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0915-3942&client=summon