Hybrid Maps Enhanced Localization System for Mobile Manipulator in Harsh Manufacturing Workshop

With excellent mobility and flexibility, mobile manipulators have great potential for loading and unloading tasks of numerical control machine tools (CNC) in manufacturing workshops. However, because of the rough and oily ground, dynamic obstacles and the convex plate of a CNC, harsh manufacturing w...

Full description

Saved in:
Bibliographic Details
Published inIEEE access Vol. 8; pp. 10782 - 10795
Main Authors Li, Gen, Huang, Yu, Zhang, Xiaolong, Liu, Chao, Shao, Wenjun, Jiang, Liquan, Meng, Jie
Format Journal Article
LanguageEnglish
Published Piscataway IEEE 2020
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects
Online AccessGet full text

Cover

Loading…
Abstract With excellent mobility and flexibility, mobile manipulators have great potential for loading and unloading tasks of numerical control machine tools (CNC) in manufacturing workshops. However, because of the rough and oily ground, dynamic obstacles and the convex plate of a CNC, harsh manufacturing workshop poses a huge challenge to the localization system of an autonomous mobile manipulator. To address the above problem, this paper presents a hybrid maps enhanced localization system which mainly consists of a global localization method and a pose tracking method. Hybrid maps including hybrid grid map, multi-resolution likelihood fields (MLFs) and hybrid point map are constructed to efficaciously model the harsh environment and to improve localization performance. Our global localization method employs the convex hull sampling to spares dense Lidar data and the MLFs based branch and bound (BnB) search to speed up global search. To achieve real-time localization reliably and accurately, our pose tracking method seamlessly combines the BnB search and the adaptive Monte Carlo localization, and the Iterative Closest Point (ICP) based scan matching using the hybrid point map is adopted for higher accuracy. In addition, a distance filter improved by unscented transform is integrated into the pose tracking process to mitigate the influence of dynamic obstacles. The developed localization system is evaluated through different experiments including two weeks of loading and unloading tasks in a real manufacturing scenario, resulting in superior localization performance.
AbstractList With excellent mobility and flexibility, mobile manipulators have great potential for loading and unloading tasks of numerical control machine tools (CNC) in manufacturing workshops. However, because of the rough and oily ground, dynamic obstacles and the convex plate of a CNC, harsh manufacturing workshop poses a huge challenge to the localization system of an autonomous mobile manipulator. To address the above problem, this paper presents a hybrid maps enhanced localization system which mainly consists of a global localization method and a pose tracking method. Hybrid maps including hybrid grid map, multi-resolution likelihood fields (MLFs) and hybrid point map are constructed to efficaciously model the harsh environment and to improve localization performance. Our global localization method employs the convex hull sampling to spares dense Lidar data and the MLFs based branch and bound (BnB) search to speed up global search. To achieve real-time localization reliably and accurately, our pose tracking method seamlessly combines the BnB search and the adaptive Monte Carlo localization, and the Iterative Closest Point (ICP) based scan matching using the hybrid point map is adopted for higher accuracy. In addition, a distance filter improved by unscented transform is integrated into the pose tracking process to mitigate the influence of dynamic obstacles. The developed localization system is evaluated through different experiments including two weeks of loading and unloading tasks in a real manufacturing scenario, resulting in superior localization performance.
Author Liu, Chao
Huang, Yu
Zhang, Xiaolong
Meng, Jie
Li, Gen
Shao, Wenjun
Jiang, Liquan
Author_xml – sequence: 1
  givenname: Gen
  orcidid: 0000-0001-7511-7308
  surname: Li
  fullname: Li, Gen
  organization: School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China
– sequence: 2
  givenname: Yu
  surname: Huang
  fullname: Huang, Yu
  organization: School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China
– sequence: 3
  givenname: Xiaolong
  orcidid: 0000-0003-2808-1220
  surname: Zhang
  fullname: Zhang, Xiaolong
  organization: School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China
– sequence: 4
  givenname: Chao
  surname: Liu
  fullname: Liu, Chao
  organization: School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China
– sequence: 5
  givenname: Wenjun
  surname: Shao
  fullname: Shao, Wenjun
  organization: School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China
– sequence: 6
  givenname: Liquan
  surname: Jiang
  fullname: Jiang, Liquan
  organization: School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China
– sequence: 7
  givenname: Jie
  surname: Meng
  fullname: Meng, Jie
  email: mengjie_10@hust.edu.cn
  organization: School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China
BookMark eNqFUU1PGzEQtRCVoMAv4LJSz0nHX7vrI4rSBimoh4B6tGyvTZwu9tb2HtJf3w2LUNULc5nR03tvRvM-o_MQg0XoFsMSYxBf71ar9W63JEBgSUTNKcAZuiS4FgvKaX3-z3yBbnI-wFTtBPHmEsnNUSffVQ9qyNU67FUwtqu20aje_1HFx1DtjrnYl8rFVD1E7Xs7kYMfxl6VCfKh2qiU9ydwdMqUMfnwXP2M6Vfex-EafXKqz_bmrV-hp2_rx9Vmsf3x_X51t10Y1rCyEKoRTFEQrsOaATVKcE5ANwY0pRza1unG1aAwKG4oEVy3nXYcOG9I3Wl6he5n3y6qgxySf1HpKKPy8hWI6VmqVLzprcStYB3nlGlwDJzRwBw1lgnDLLaumby-zF5Dir9Hm4s8xDGF6XxJGGdNSwTGE4vOLJNizsm6960Y5CkYOQcjT8HIt2AmlfhPZXx5_XNJyvcfaG9nrbfWvm9rBWc1FvQvi--dOA
CODEN IAECCG
CitedBy_id crossref_primary_10_1088_1361_6501_ac3d06
crossref_primary_10_1007_s42452_021_04506_7
crossref_primary_10_1088_1361_6501_abce71
crossref_primary_10_1016_j_measurement_2022_112411
crossref_primary_10_1177_09544054221135930
crossref_primary_10_1016_j_measurement_2021_109212
crossref_primary_10_1109_TIM_2021_3093933
crossref_primary_10_1177_09544089231191906
crossref_primary_10_3390_s21093228
crossref_primary_10_1007_s40313_023_01024_2
crossref_primary_10_1109_JSEN_2021_3111196
crossref_primary_10_1109_ACCESS_2022_3153083
crossref_primary_10_3390_s20185238
Cites_doi 10.1109/IROS.2012.6385988
10.1177/0278364913502830
10.1109/AIM.2019.8868652
10.1109/ICRA.2016.7487258
10.1109/IROS.2017.8206264
10.1007/s10845-015-1072-2
10.1109/AIM.2019.8868921
10.1109/IVS.2015.7225751
10.1109/ACCESS.2019.2919989
10.1109/ROBOT.2008.4543251
10.1109/TNET.2017.2766526
10.1109/ACCESS.2019.2915115
10.1023/A:1025584807625
10.1007/s10514-016-9557-1
10.1145/1015330.1015413
10.1109/TII.2015.2462771
10.1109/MED.2014.6961527
10.1016/S0004-3702(01)00069-8
10.1016/j.rcim.2018.05.008
10.1016/j.inffus.2018.09.003
10.1016/j.rcim.2016.05.001
10.1002/rob.21735
10.1177/0278364903022012001
10.1016/j.robot.2016.09.005
10.1002/rob.21531
10.1177/0278364917696568
10.1109/TITS.2016.2561626
10.1109/ACCESS.2019.2903435
10.1017/S0263574712000732
10.1109/TRO.2016.2544301
10.1109/IROS.2011.6094625
10.1109/IROS.2018.8593854
10.1109/IROS.2011.6094720
10.3390/s19153331
10.1109/IROS.2016.7759665
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020
DBID 97E
ESBDL
RIA
RIE
AAYXX
CITATION
7SC
7SP
7SR
8BQ
8FD
JG9
JQ2
L7M
L~C
L~D
DOA
DOI 10.1109/ACCESS.2020.2965300
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE Xplore Open Access Journals
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Engineered Materials Abstracts
METADEX
Technology Research Database
Materials Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
Materials Research Database
Engineered Materials Abstracts
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
METADEX
Computer and Information Systems Abstracts Professional
DatabaseTitleList

Materials Research Database
Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ Directory of Open Access Journals
  url: https://www.doaj.org/
  sourceTypes: Open Website
– sequence: 2
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 2169-3536
EndPage 10795
ExternalDocumentID oai_doaj_org_article_1894d5534b0f40fcb04f3ce49c4e1ef7
10_1109_ACCESS_2020_2965300
8954619
Genre orig-research
GrantInformation_xml – fundername: Science and Technology Planning Project of Guangdong Province
  grantid: 2017B090913001
  funderid: 10.13039/501100012245
– fundername: Guangdong Major Science and Technology Project
  grantid: 2019B090919003
– fundername: Dongguan Innovative Research Team Program
  grantid: 201536000100031
– fundername: National Natural Science Foundation of China
  grantid: 51805190
  funderid: 10.13039/501100001809
– fundername: Launch fund of the School of Mechanical Science and Engineering, Huazhong University of Science and Technology
  grantid: 100-0199100041
  funderid: 10.13039/501100003397
GroupedDBID 0R~
4.4
5VS
6IK
97E
AAJGR
ABAZT
ABVLG
ACGFS
ADBBV
AGSQL
ALMA_UNASSIGNED_HOLDINGS
BCNDV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
EBS
EJD
ESBDL
GROUPED_DOAJ
IPLJI
JAVBF
KQ8
M43
M~E
O9-
OCL
OK1
RIA
RIE
RNS
AAYXX
CITATION
RIG
7SC
7SP
7SR
8BQ
8FD
JG9
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c474t-9a794a309fd1b403ca95520b7c0b335088fb7f60a10a5c3295b8dbf5055726db3
IEDL.DBID RIE
ISSN 2169-3536
IngestDate Wed Aug 27 00:56:27 EDT 2025
Mon Jun 30 04:36:47 EDT 2025
Tue Jul 01 01:22:04 EDT 2025
Thu Apr 24 23:05:34 EDT 2025
Wed Aug 27 05:51:14 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Language English
License https://creativecommons.org/licenses/by/4.0/legalcode
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c474t-9a794a309fd1b403ca95520b7c0b335088fb7f60a10a5c3295b8dbf5055726db3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0001-7511-7308
0000-0003-2808-1220
OpenAccessLink https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/document/8954619
PQID 2454782911
PQPubID 4845423
PageCount 14
ParticipantIDs proquest_journals_2454782911
crossref_citationtrail_10_1109_ACCESS_2020_2965300
ieee_primary_8954619
doaj_primary_oai_doaj_org_article_1894d5534b0f40fcb04f3ce49c4e1ef7
crossref_primary_10_1109_ACCESS_2020_2965300
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 20200000
2020-00-00
20200101
2020-01-01
PublicationDateYYYYMMDD 2020-01-01
PublicationDate_xml – year: 2020
  text: 20200000
PublicationDecade 2020
PublicationPlace Piscataway
PublicationPlace_xml – name: Piscataway
PublicationTitle IEEE access
PublicationTitleAbbrev Access
PublicationYear 2020
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref35
ref13
ref34
ref12
ref15
ref36
ref14
ref31
jayaram (ref30) 2016; 6
ref33
ref11
ref32
ref10
ref2
ref1
ref17
ref16
ref19
ref18
ref24
ref23
ref26
ref25
ref20
ref22
ref21
ref28
ref27
ref29
ref8
ref7
ref9
ref4
ref3
ref6
ref5
References_xml – ident: ref24
  doi: 10.1109/IROS.2012.6385988
– ident: ref26
  doi: 10.1177/0278364913502830
– ident: ref10
  doi: 10.1109/AIM.2019.8868652
– ident: ref17
  doi: 10.1109/ICRA.2016.7487258
– ident: ref22
  doi: 10.1109/IROS.2017.8206264
– ident: ref1
  doi: 10.1007/s10845-015-1072-2
– ident: ref36
  doi: 10.1109/AIM.2019.8868921
– ident: ref6
  doi: 10.1109/IVS.2015.7225751
– ident: ref16
  doi: 10.1109/ACCESS.2019.2919989
– ident: ref31
  doi: 10.1109/ROBOT.2008.4543251
– ident: ref9
  doi: 10.1109/TNET.2017.2766526
– ident: ref2
  doi: 10.1109/ACCESS.2019.2915115
– ident: ref25
  doi: 10.1023/A:1025584807625
– ident: ref4
  doi: 10.1007/s10514-016-9557-1
– ident: ref32
  doi: 10.1145/1015330.1015413
– ident: ref8
  doi: 10.1109/TII.2015.2462771
– ident: ref29
  doi: 10.1109/MED.2014.6961527
– ident: ref13
  doi: 10.1016/S0004-3702(01)00069-8
– ident: ref5
  doi: 10.1016/j.rcim.2018.05.008
– ident: ref21
  doi: 10.1016/j.inffus.2018.09.003
– ident: ref3
  doi: 10.1016/j.rcim.2016.05.001
– ident: ref28
  doi: 10.1002/rob.21735
– ident: ref20
  doi: 10.1177/0278364903022012001
– ident: ref34
  doi: 10.1016/j.robot.2016.09.005
– ident: ref7
  doi: 10.1002/rob.21531
– ident: ref18
  doi: 10.1177/0278364917696568
– ident: ref33
  doi: 10.1109/TITS.2016.2561626
– ident: ref12
  doi: 10.1109/ACCESS.2019.2903435
– ident: ref14
  doi: 10.1017/S0263574712000732
– ident: ref15
  doi: 10.1109/TRO.2016.2544301
– ident: ref23
  doi: 10.1109/IROS.2011.6094625
– ident: ref11
  doi: 10.1109/IROS.2018.8593854
– ident: ref19
  doi: 10.1109/IROS.2011.6094720
– ident: ref27
  doi: 10.3390/s19153331
– ident: ref35
  doi: 10.1109/IROS.2016.7759665
– volume: 6
  start-page: 48
  year: 2016
  ident: ref30
  article-title: Convex hulls in image processing: A scoping review
  publication-title: Am J Intell Syst
SSID ssj0000816957
Score 2.2817304
Snippet With excellent mobility and flexibility, mobile manipulators have great potential for loading and unloading tasks of numerical control machine tools (CNC) in...
SourceID doaj
proquest
crossref
ieee
SourceType Open Website
Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 10782
SubjectTerms Adaptive search techniques
Barriers
Conferences
Convexity
global localization
hybrid maps
Hybrid systems
Iterative methods
Laser radar
Localization method
localization system
Machine tools
Manipulators
Manufacturing
manufacturing workshop
Mobile manipulator
Numerical controls
pose tracking
Reliability
Robot sensing systems
Searching
Three dimensional models
Tracking
Workshops
SummonAdditionalLinks – databaseName: DOAJ Directory of Open Access Journals
  dbid: DOA
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3NT8MgFCfGkx6Mn3E6DQePVik82nKci2YxzpNLvJFCITMx3eK2g_-9D4rLEhO9eH2FUh6P90F5v0fIFfBaNa6ATJVGZmC4zSqoXCbAiNx65vB5uG3xXIwm8PgqXzdKfYU7YR08cMe427xS0EiJfZkH5q1h4IV1oCy43PmYR442byOYijq4ygslywQzlDN1OxgOcUYYEHJ2w1UhRchp2zBFEbE_lVj5oZejsXnYJ3vJS6SD7usOyJZrD8nuBnbgEdGjz5BsRcf1fEHv22n8k0-fgmlKqZW0QyOn6JbS8czg9sfG7Vss2IWkt5aOMKqdBuIq5DfEhEUaTs8X09n8mEwe7l-GoyxVS8gslLDMVI1bqxZM-SY3wIStlZScmdIyI0Tww7wpfcHqnNXSCq6kqRrjZQDh4kVjxAnZbmetOyUUnSTXONVUHDwyv6q5hRxHUegMWOtlj_BvxmmboMRDRYt3HUMKpnTHbR24rRO3e-R63WneIWn83vwurMi6aYDBjgQUDp2EQ_8lHD1yFNZz_ZJKScCIsUf63-ur05ZdaB6hzTgq_7P_GPqc7ITpdKc1fbK9_Fi5C_RfluYyiuoXJOvqDw
  priority: 102
  providerName: Directory of Open Access Journals
Title Hybrid Maps Enhanced Localization System for Mobile Manipulator in Harsh Manufacturing Workshop
URI https://ieeexplore.ieee.org/document/8954619
https://www.proquest.com/docview/2454782911
https://doaj.org/article/1894d5534b0f40fcb04f3ce49c4e1ef7
Volume 8
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Lb9swDBa6nrbDXt2wdF2hw451KkuUbR27oEUwLDutQG-CJUtIscEJmuSw_fqSsmIU61DsZsiSTYOU-DD5kbHPIFvThQoKUztdgJO-aKAJhQKnSh9FwPuUbfG9ml_D1xt9c8DOxlqYEEJKPgtTukz_8ruV31Go7LwxGirC-HyGjttQqzXGU6iBhNF1BhYqhTm_mM3wG9AFlGIqTaUVVbE9UD4Joz83VXl0Eif1cvWKLfaEDVklP6e7rZv6P39hNv4v5a_Zy2xn8otBMN6wg9C_ZS8eoA8eMTv_TeVafNGuN_yyX6ZcAP6NlFsuzuQDnjlHw5YvVg4PEJzc36aWXzh02_M5-sVLGtxRhUQqeeQUf98sV-t37Prq8sdsXuR-C4WHGraFaXFztkqY2JUOhPKt0VoKV3vhlCJLLro6VqItRau9kka7pnNRE4yXrDqn3rPDftWHD4yjmRW6YLpGQoRON630UOJbDJoT3kc9YXLPCOszGDn1xPhlk1MijB24Z4l7NnNvws7GResBi-Pp6V-Iw-NUAtJOA8gZm_elLRuD9GkUTRFBRO8EROUDGA-hDLGesCPi5viQzMgJO9nLi82bfmNlAkeTqD6O_73qI3tOBA4RnBN2uL3bhU9o02zdaYoFnCaRvgctXvQn
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1NT9wwELUQPbQc2lKK2JaCDz2SxfFHEh_pCpS2u5xA4mbFjq1FoOyqu3tof31nHG-E2qriFjl2MskbZ8YTzxtCPkve6NYXMtOlVZm03GWVrHwmpBW5C8zDedxtcV3Ut_LbnbrbIWdDLoz3Pm4-82M8jP_y24XbYKjsvNJKFsjx-QLsvuJ9ttYQUcESElqViVooZ_r8YjKBp4BFIGdjrgslMI_tifmJLP2prMpf3-JoYK7ekNlWtH5fycN4s7Zj9-sP1sbnyv6WvE6eJr3oVWOf7PjuHdl7wj94QEz9ExO26KxZruhlN4-7AegUzVtKz6Q9ozkF15bOFhY-IdC5u49Fv6DpvqM1rIzn2LjBHImY9EgxAr-aL5bvye3V5c2kzlLFhczJUq4z3cD0bATToc2tZMI1Gt4zs6VjVgj05YItQ8GanDXKCa6VrVobFBJ58aK14pDsdovOHxEKjpZvvW4rLoNsVdVwJ3O4iwaHwrmgRoRvgTAu0ZFjVYxHE5clTJsePYPomYTeiJwNg5Y9G8f_u39BhIeuSKUdGwAZk2amySsN8ilQThYkC84yGYTzUjvpcx_KETlANIeLJCBH5HirLyZN-5XhkR6NgwH58O9Rp-RlfTObmunX6-8fySsUto_nHJPd9Y-N_wQeztqeRMX-DU2Z9nw
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Hybrid+Maps+Enhanced+Localization+System+for+Mobile+Manipulator+in+Harsh+Manufacturing+Workshop&rft.jtitle=IEEE+access&rft.au=Li%2C+Gen&rft.au=Huang%2C+Yu&rft.au=Zhang%2C+Xiaolong&rft.au=Liu%2C+Chao&rft.date=2020&rft.pub=IEEE&rft.eissn=2169-3536&rft.volume=8&rft.spage=10782&rft.epage=10795&rft_id=info:doi/10.1109%2FACCESS.2020.2965300&rft.externalDocID=8954619
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2169-3536&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2169-3536&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2169-3536&client=summon