A Shared Control Method for Collaborative Human-Robot Plug Task

Humans are superior to robots in performing complex assembly tasks primarily due to their dexterity and sensorimotor abilities. When humans and robots collaborate to complete an assembly task, it is critical to provide the robot with sufficiently precise manipulation capabilities and formulate a sha...

Full description

Saved in:
Bibliographic Details
Published inIEEE robotics and automation letters Vol. 6; no. 4; pp. 7429 - 7436
Main Authors Chang, Peng, Luo, Rui, Dorostian, Mehrdad, Padr, Taskn
Format Journal Article
LanguageEnglish
Published Piscataway IEEE 01.10.2021
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects
Online AccessGet full text
ISSN2377-3766
2377-3766
DOI10.1109/LRA.2021.3098323

Cover

Abstract Humans are superior to robots in performing complex assembly tasks primarily due to their dexterity and sensorimotor abilities. When humans and robots collaborate to complete an assembly task, it is critical to provide the robot with sufficiently precise manipulation capabilities and formulate a shared control method that coordinates human and robot actions. In this study, we are investigating human-robot collaboration in completing an assembly task, namely the plug task. The plug task, motivated by the 2015 DARPA Robotics Challenge Finals, involves inserting a plug connected with a cable into a paired socket. The human holds the socket while the robot is grasping the cable and manages to insert the plug. We estimate an initial socket pose based on human subjects' data. With the statistically calculated initial guess, the robot could act instantly from the beginning to move the plug towards an initial target. The actual socket pose is updated using the Kalman filter in real-time. Besides, the system continuously updates the cable model and tracks the plug to enable visual servoing to complete the plug task. The result of an extensive experimental study demonstrates that the proposed approach demonstrates fast and accurate performance as well as flexibility when compared to a state-of-the-art method based on interactive probabilistic movement primitives.
AbstractList Humans are superior to robots in performing complex assembly tasks primarily due to their dexterity and sensorimotor abilities. When humans and robots collaborate to complete an assembly task, it is critical to provide the robot with sufficiently precise manipulation capabilities and formulate a shared control method that coordinates human and robot actions. In this study, we are investigating human-robot collaboration in completing an assembly task, namely the plug task. The plug task, motivated by the 2015 DARPA Robotics Challenge Finals, involves inserting a plug connected with a cable into a paired socket. The human holds the socket while the robot is grasping the cable and manages to insert the plug. We estimate an initial socket pose based on human subjects’ data. With the statistically calculated initial guess, the robot could act instantly from the beginning to move the plug towards an initial target. The actual socket pose is updated using the Kalman filter in real-time. Besides, the system continuously updates the cable model and tracks the plug to enable visual servoing to complete the plug task. The result of an extensive experimental study demonstrates that the proposed approach demonstrates fast and accurate performance as well as flexibility when compared to a state-of-the-art method based on interactive probabilistic movement primitives.
Author Chang, Peng
Padr, Taskn
Luo, Rui
Dorostian, Mehrdad
Author_xml – sequence: 1
  givenname: Peng
  orcidid: 0000-0003-1439-8315
  surname: Chang
  fullname: Chang, Peng
  email: chang.pe@northeastern.edu
  organization: Institute for Experiential Robotics, Northeastern University, Boston, USA
– sequence: 2
  givenname: Rui
  orcidid: 0000-0001-6508-5488
  surname: Luo
  fullname: Luo, Rui
  email: luo.rui@husky.neu.edu
  organization: Institute for Experiential Robotics, Northeastern University, Boston, USA
– sequence: 3
  givenname: Mehrdad
  orcidid: 0000-0003-0185-6532
  surname: Dorostian
  fullname: Dorostian, Mehrdad
  email: Dorostian.m@northeastern.edu
  organization: Institute for Experiential Robotics, Northeastern University, Boston, USA
– sequence: 4
  givenname: Taskn
  orcidid: 0000-0001-5123-5801
  surname: Padr
  fullname: Padr, Taskn
  email: t.padir@northeastern.edu
  organization: Institute for Experiential Robotics, Northeastern University, Boston, USA
BookMark eNp9kEFLAzEQhYNUsNbeBS8LnrcmmW6yOUkp1goVpdZzyO4mdut2U5Os4L83pUXEg6cZhu_NvHnnqNfaViN0SfCIECxuFsvJiGJKRoBFDhROUJ8C5ylwxnq_-jM09H6DMSYZ5SCyPrqdJC9r5XSVTG0bnG2SRx3WtkqMdXHUNKqwToX6UyfzbqvadGkLG5LnpntLVsq_X6BToxqvh8c6QK-zu9V0ni6e7h-mk0VaUkFCKsaCGVyOgUcbJMt5zrQhjBQFaKMqUIySwox5IQjRAiojsKgUF3lVAqeGwgBdH_bunP3otA9yYzvXxpOSZhkXPLIQKXagSme9d9rIsg7R_f41VTeSYLnPS8a85D4vecwrCvEf4c7VW-W-_pNcHSS11voHj4_SnDL4BvnbdTU
CODEN IRALC6
CitedBy_id crossref_primary_10_1109_TRO_2025_3532510
crossref_primary_10_1146_annurev_control_071223_105834
Cites_doi 10.1109/IROS.2014.6942851
10.1016/B978-190399666-9/50002-6
10.1109/ICRA.2011.5979561
10.1145/2909824.3020252
10.1109/ICRA.2019.8794008
10.1109/HRI.2016.7451736
10.15607/RSS.2021.XVII.036
10.1109/IROS.2006.6936985
10.1109/ROMAN.2014.6926397
10.1109/LRA.2018.2864353
10.1109/IROS.2015.7353106
10.1109/LRA.2016.2535907
10.1109/ICRA.2017.7989411
10.1145/3171221.3171264
10.1109/AIM43001.2020.9159044
10.1145/3203305
10.1109/IROS40897.2019.8968109
10.7551/mitpress/9816.003.0061
10.1109/TRO.2015.2430053
10.3390/machines8030046
10.1109/HUMANOIDS.2018.8625068
10.1109/IROS.2018.8593766
10.1109/SSRR.2019.8848977
10.1109/IROS.2017.8206205
10.1109/LRA.2021.3086666
10.1080/01691864.2016.1250674
10.5898/JHRI.2.1.Strabala
10.1007/s10514-016-9556-2
10.1007/s12369-016-0357-8
10.1109/IROS.2018.8593921
10.1109/LRA.2020.3003882
10.1007/978-3-319-74666-1
10.1002/rob.21685
10.1016/j.mechmachtheory.2007.03.003
10.1007/s10514-017-9677-2
10.1109/TRO.2015.2419873
10.1109/HSI47298.2019.8942606
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
DOI 10.1109/LRA.2021.3098323
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE/IET Electronic Library
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts Professional
DatabaseTitleList Technology Research Database

Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Xplore Digital Library
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 2377-3766
EndPage 7436
ExternalDocumentID 10_1109_LRA_2021_3098323
9492826
Genre orig-research
GrantInformation_xml – fundername: National Science Foundation
  grantid: 1928654; 1935337; 1944453; 1952032
  funderid: 10.13039/501100008982
GroupedDBID 0R~
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFS
AGQYO
AGSQL
AHBIQ
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
EBS
EJD
IFIPE
IPLJI
JAVBF
KQ8
M43
M~E
O9-
OCL
RIA
RIE
AAYXX
CITATION
RIG
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c291t-9496f0c437376158786ef161bb3efad3a621bf47b911e93df909da798dc372f23
IEDL.DBID RIE
ISSN 2377-3766
IngestDate Mon Jun 30 05:07:55 EDT 2025
Tue Jul 01 03:54:07 EDT 2025
Thu Apr 24 22:55:12 EDT 2025
Wed Aug 27 02:39:34 EDT 2025
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 4
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c291t-9496f0c437376158786ef161bb3efad3a621bf47b911e93df909da798dc372f23
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0003-1439-8315
0000-0001-6508-5488
0000-0003-0185-6532
0000-0001-5123-5801
PQID 2557977983
PQPubID 4437225
PageCount 8
ParticipantIDs ieee_primary_9492826
crossref_citationtrail_10_1109_LRA_2021_3098323
crossref_primary_10_1109_LRA_2021_3098323
proquest_journals_2557977983
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2021-10-01
PublicationDateYYYYMMDD 2021-10-01
PublicationDate_xml – month: 10
  year: 2021
  text: 2021-10-01
  day: 01
PublicationDecade 2020
PublicationPlace Piscataway
PublicationPlace_xml – name: Piscataway
PublicationTitle IEEE robotics and automation letters
PublicationTitleAbbrev LRA
PublicationYear 2021
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref35
ref13
ref34
ref12
ref37
ref15
ref36
ref14
ref31
ref30
ref32
ref2
ref1
ref39
ref17
ref38
ref16
ref19
ref18
katyara (ref10) 2020; abs 2012 7046
ref23
ref26
ref25
ref20
ref22
vianello (ref24) 2021
ref21
ref28
wilcox (ref11) 2013; 8
ref27
ref29
ref8
chang (ref33) 2020
ref7
ref9
ref4
ref3
ref6
ref5
References_xml – ident: ref36
  doi: 10.1109/IROS.2014.6942851
– ident: ref39
  doi: 10.1016/B978-190399666-9/50002-6
– ident: ref38
  doi: 10.1109/ICRA.2011.5979561
– ident: ref21
  doi: 10.1145/2909824.3020252
– ident: ref23
  doi: 10.1109/ICRA.2019.8794008
– ident: ref20
  doi: 10.1109/HRI.2016.7451736
– ident: ref19
  doi: 10.15607/RSS.2021.XVII.036
– ident: ref15
  doi: 10.1109/IROS.2006.6936985
– ident: ref16
  doi: 10.1109/ROMAN.2014.6926397
– ident: ref8
  doi: 10.1109/LRA.2018.2864353
– ident: ref2
  doi: 10.1109/IROS.2015.7353106
– ident: ref12
  doi: 10.1109/LRA.2016.2535907
– ident: ref3
  doi: 10.1109/ICRA.2017.7989411
– ident: ref22
  doi: 10.1145/3171221.3171264
– ident: ref31
  doi: 10.1109/AIM43001.2020.9159044
– ident: ref25
  doi: 10.1145/3203305
– ident: ref9
  doi: 10.1109/IROS40897.2019.8968109
– volume: 8
  start-page: 441
  year: 2013
  ident: ref11
  article-title: Optimization of temporal dynamics for adaptive human-robot interaction in assembly manufacturing
  publication-title: Robot
  doi: 10.7551/mitpress/9816.003.0061
– volume: abs 2012 7046
  year: 2020
  ident: ref10
  article-title: Vision based adaptation to kernelized synergies for human inspired robotic manipulation
  publication-title: CoRR
– ident: ref18
  doi: 10.1109/TRO.2015.2430053
– ident: ref32
  doi: 10.3390/machines8030046
– ident: ref37
  doi: 10.1109/HUMANOIDS.2018.8625068
– ident: ref34
  doi: 10.1109/IROS.2018.8593766
– ident: ref6
  doi: 10.1109/SSRR.2019.8848977
– ident: ref4
  doi: 10.1109/IROS.2017.8206205
– year: 2021
  ident: ref24
  article-title: Probabilistic inverse kinematics for human posture prediction during physical human-robot interaction
  publication-title: IEEE Robot Autom Lett
  doi: 10.1109/LRA.2021.3086666
– ident: ref29
  doi: 10.1080/01691864.2016.1250674
– ident: ref1
  doi: 10.5898/JHRI.2.1.Strabala
– ident: ref35
  doi: 10.1007/s10514-016-9556-2
– ident: ref13
  doi: 10.1007/s12369-016-0357-8
– ident: ref5
  doi: 10.1109/IROS.2018.8593921
– ident: ref7
  doi: 10.1109/LRA.2020.3003882
– ident: ref28
  doi: 10.1007/978-3-319-74666-1
– ident: ref30
  doi: 10.1002/rob.21685
– ident: ref14
  doi: 10.1016/j.mechmachtheory.2007.03.003
– ident: ref17
  doi: 10.1007/s10514-017-9677-2
– ident: ref27
  doi: 10.1109/TRO.2015.2419873
– start-page: 56
  year: 2020
  ident: ref33
  article-title: Sim2real2sim: Bridging the gap between simulation and real-world in flexible object manipulation
  publication-title: Proc 4th IEEE Int Conf Robotic Comput
– ident: ref26
  doi: 10.1109/HSI47298.2019.8942606
SSID ssj0001527395
Score 2.2140572
Snippet Humans are superior to robots in performing complex assembly tasks primarily due to their dexterity and sensorimotor abilities. When humans and robots...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 7429
SubjectTerms Assembly
Automation
Collaboration
Control methods
Grasping (robotics)
human-robot collaboration
Kalman filters
Manufacturing engineering
Physical human-robot interaction
Plugs
Robot kinematics
Robot vision systems
Robotics
Robots
Sockets
Task analysis
Task complexity
Visual control
Title A Shared Control Method for Collaborative Human-Robot Plug Task
URI https://ieeexplore.ieee.org/document/9492826
https://www.proquest.com/docview/2557977983
Volume 6
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV07T8MwED7RTjDwKohCQR5YkEibOIkTT6iqQAgRhKpWYov8CgOoQTRlYOC3c86jPIXYMvgiy3e2vzvffQdwrLjHI6GYoxgLnQABsSM8TzhGeSI0TCsW20Lh5IZdToOru_BuBU6XtTDGmDL5zPTtZ_mWr3O1sKGyAQ84egisBS00s6pW6yOeYpnEeNi8RLp8cD0eov9Hvb7vcrRb_8vNU7ZS-XH-lpfKxQYkzXSqXJKH_qKQffX6janxv_PdhPUaXZJhZQ5bsGJm27D2iXOwA2dDYkmajSajKkudJGUTaYLolYw-rOLFkDLA74xzmRfk9nFxTyZi_rAD04vzyejSqbsoOIpyr3BwEixzlaUwihC-xFHMTIY4T0rfZEL7glFPZkEk8dgz3NcZd7kWEY-18iOaUX8X2rN8ZvaAUKWpcSMpaJgFVKH-Yy6ZpLHMEChR3YVBs8KpqinGbaeLx7R0NVyeok5Sq5O01kkXTpYSTxW9xh9jO3aJl-Pq1e1Cr1FiWu-_eYqOUoTIFuX2f5c6gFX77yotrwft4nlhDhFeFPIIWsnb-VFpXe_7-80T
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV07T8MwED5BGYCBV0EUCnhgQSJt4iROPKGqAhVoEapaiS3yKwxFLYKUgV_POUlbXkJsGWzl5Dv7vrPvvgM4VdzjkVDMUYyFToCA2BGeJxyjPBEaphWLbaFw7451hsHNQ_iwBOfzWhhjTJ58Zhr2M3_L1xM1tVdlTR5wjBDYMqyg3w_ColprcaNiucR4OHuLdHmz229hBEi9hu9ytFz_i-_Jm6n8OIFzt3K1Cb2ZQEU2yagxzWRDvX_javyvxFuwUeJL0ioMYhuWzHgH1j-xDlbhokUsTbPRpF3kqZNe3kaaIH4l7YVdvBmSX_E7_YmcZOT-afpIBuJ1tAvDq8tBu-OUfRQcRbmXOSgES11lSYwiBDBxFDOTItKT0jep0L5g1JNpEEk8-Az3dcpdrkXEY638iKbU34PKeDI2-0Co0tS4kRQ0TAOq0AJiLpmksUwRKlFdg-ZshRNVkozbXhdPSR5suDxBnSRWJ0mpkxqczWc8FwQbf4yt2iWejytXtwb1mRKTcge-JhgqRYhtcd7B77NOYLUz6HWT7vXd7SGs2f8USXp1qGQvU3OEYCOTx7mNfQAKI88v
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Shared+Control+Method+for+Collaborative+Human-Robot+Plug+Task&rft.jtitle=IEEE+robotics+and+automation+letters&rft.au=Chang%2C+Peng&rft.au=Luo%2C+Rui&rft.au=Dorostian%2C+Mehrdad&rft.au=Padr%2C+Taskn&rft.date=2021-10-01&rft.pub=IEEE&rft.eissn=2377-3766&rft.volume=6&rft.issue=4&rft.spage=7429&rft.epage=7436&rft_id=info:doi/10.1109%2FLRA.2021.3098323&rft.externalDocID=9492826
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2377-3766&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2377-3766&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2377-3766&client=summon