A Shared Autonomy Reconfigurable Control Framework for Telemanipulation of Multi-Arm Systems

Teleoperation is a widely adopted strategy to control robotic manipulators executing complex tasks that require highly dexterous movements and critical high-level intelligence. Classical teleoperation schemes are based on either joystick control, or on more intuitive interfaces which map directly th...

Full description

Saved in:
Bibliographic Details
Published inIEEE robotics and automation letters Vol. 7; no. 4; pp. 9937 - 9944
Main Authors Ozdamar, Idil, Laghi, Marco, Grioli, Giorgio, Ajoudani, Arash, Catalano, Manuel G., Bicchi, Antonio
Format Journal Article
LanguageEnglish
Published Piscataway IEEE 01.10.2022
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects
Online AccessGet full text
ISSN2377-3766
2377-3766
DOI10.1109/LRA.2022.3191200

Cover

Loading…
Abstract Teleoperation is a widely adopted strategy to control robotic manipulators executing complex tasks that require highly dexterous movements and critical high-level intelligence. Classical teleoperation schemes are based on either joystick control, or on more intuitive interfaces which map directly the user arm motions into one robot arm's motions. These approaches have limits when the execution of a given task requires reconfigurable multiple robotic arm systems. Indeed, the simultaneous teleoperation of two or more robot arms could extend the workspace of the manipulation cell, or increase its total payload, or afford other advantages. In different phases of a reconfigurable multi-arm system, each robot could act as an independent arm, or as one of a pair of cooperating arms, or as one of the fingers of a virtual, large robot hand. This manuscript proposes a novel telemanipulation framework that enables both the individual and combined control of any number of robotic arms. Thanks to the designed control architecture, the human operator can intuitively choose the proposed control modalities and the manipulators that make the task convenient to execute through the user interface. Moreover, through the tele-impedance paradigm, the system can address complex tasks that require physical interaction by letting the robot mimic the arm impedance and position references of the human operator. The proposed framework is validated with 8 subjects controlling 4 Franka Emika Panda robots with 7-DoFs to execute a telemanipulation task. Qualitative results of the experiments show us the promising applicability of our framework.
AbstractList Teleoperation is a widely adopted strategy to control robotic manipulators executing complex tasks that require highly dexterous movements and critical high-level intelligence. Classical teleoperation schemes are based on either joystick control, or on more intuitive interfaces which map directly the user arm motions into one robot arm's motions. These approaches have limits when the execution of a given task requires reconfigurable multiple robotic arm systems. Indeed, the simultaneous teleoperation of two or more robot arms could extend the workspace of the manipulation cell, or increase its total payload, or afford other advantages. In different phases of a reconfigurable multi-arm system, each robot could act as an independent arm, or as one of a pair of cooperating arms, or as one of the fingers of a virtual, large robot hand. This manuscript proposes a novel telemanipulation framework that enables both the individual and combined control of any number of robotic arms. Thanks to the designed control architecture, the human operator can intuitively choose the proposed control modalities and the manipulators that make the task convenient to execute through the user interface. Moreover, through the tele-impedance paradigm, the system can address complex tasks that require physical interaction by letting the robot mimic the arm impedance and position references of the human operator. The proposed framework is validated with 8 subjects controlling 4 Franka Emika Panda robots with 7-DoFs to execute a telemanipulation task. Qualitative results of the experiments show us the promising applicability of our framework.
Author Ozdamar, Idil
Grioli, Giorgio
Bicchi, Antonio
Laghi, Marco
Catalano, Manuel G.
Ajoudani, Arash
Author_xml – sequence: 1
  givenname: Idil
  orcidid: 0000-0002-4759-9706
  surname: Ozdamar
  fullname: Ozdamar, Idil
  email: iozdamar13@ku.edu.tr
  organization: Soft Robotics for Human Cooperation and Rehabilitation (SoftBots), Istituto Italiano di Tecnologia, Genoa, Italy
– sequence: 2
  givenname: Marco
  orcidid: 0000-0002-1819-8276
  surname: Laghi
  fullname: Laghi, Marco
  email: marco.laghi89@gmail.com
  organization: Human-Robot Interfaces and Physical Interaction (HRI2), Istituto Italiano di Tecnologia, Genoa, Italy
– sequence: 3
  givenname: Giorgio
  orcidid: 0000-0002-5310-2997
  surname: Grioli
  fullname: Grioli, Giorgio
  email: giorgio.grioli@gmail.com
  organization: Soft Robotics for Human Cooperation and Rehabilitation (SoftBots), Istituto Italiano di Tecnologia, Genoa, Italy
– sequence: 4
  givenname: Arash
  orcidid: 0000-0002-1261-737X
  surname: Ajoudani
  fullname: Ajoudani, Arash
  email: arash.ajoudani@iit.it
  organization: Human-Robot Interfaces and Physical Interaction (HRI2), Istituto Italiano di Tecnologia, Genoa, Italy
– sequence: 5
  givenname: Manuel G.
  orcidid: 0000-0003-1950-6186
  surname: Catalano
  fullname: Catalano, Manuel G.
  email: manuel.catalano@iit.it
  organization: Soft Robotics for Human Cooperation and Rehabilitation (SoftBots), Istituto Italiano di Tecnologia, Genoa, Italy
– sequence: 6
  givenname: Antonio
  orcidid: 0000-0001-8635-5571
  surname: Bicchi
  fullname: Bicchi, Antonio
  email: antonio.bicchi@iit.it
  organization: Soft Robotics for Human Cooperation and Rehabilitation (SoftBots), Istituto Italiano di Tecnologia, Genoa, Italy
BookMark eNp9kM9LwzAUx4NMcM7dBS8Bz5350abNsQynwkTY5k0oafqimW0z0xTZf-_mhogHT-8dvp_35X3O0aB1LSB0ScmEUiJv5ot8wghjE04lZYScoCHjaRrxVIjBr_0MjbtuTQihCUu5TIboJcfLN-WhwnkfXOuaLV6Adq2xr71XZQ146trgXY1nXjXw6fw7Ns7jFdTQqNZu-loF61rsDH7s62Cj3Dd4ue0CNN0FOjWq7mB8nCP0PLtdTe-j-dPdwzSfR5pzHiKdqFgksaQkkVQIyqGCShoty4yDhiTWTLNYp6oyGVc05mWVsFJRacoyM5LyEbo-3N1499FDF4q16327qyyYkGkiBBHZLkUOKe1d13kwxcbbRvltQUmx11jsNBZ7jcVR4w4RfxBtw_e_wStb_wdeHUALAD89MuMkixn_AlrPgao
CODEN IRALC6
CitedBy_id crossref_primary_10_1109_ACCESS_2025_3538277
crossref_primary_10_1016_j_robot_2023_104402
crossref_primary_10_1016_j_robot_2024_104725
crossref_primary_10_1007_s11431_024_2779_8
crossref_primary_10_1109_TASE_2024_3350524
Cites_doi 10.1201/9781498710411-35
10.1109/MRA.2017.2788801
10.1109/ICRA.2014.6907261
10.1109/70.258052
10.1177/154193120104502712
10.1109/LRA.2017.2737046
10.1109/MRA.2016.2613281
10.1080/10447310802205776
10.1109/TRO.2021.3071530
10.1016/j.cirp.2014.03.017
10.1016/j.robot.2015.09.012
10.1109/ICRA.2018.8461249
10.1109/ICRA40945.2020.9197220
10.1177/0278364912464668
10.1109/IROS.2006.281912
10.1177/0278364914566516
10.1023/A:1022231703061
10.1109/ICRA.2019.8794197
10.1109/ICRA.2016.7487246
10.1109/TRO.2020.2973099
10.1177/02783649211017642
10.1126/scirobotics.aaw0955
10.1109/MRA.2016.2636366
10.1109/ICRA48506.2021.9561491
10.1109/ICRA48506.2021.9561105
10.1109/ICRA.2019.8793652
10.1177/0278364917744035
10.1016/j.robot.2012.07.005
10.1109/HUMANOIDS.2018.8625047
10.20965/jrm.2017.p0381
10.1007/978-3-540-76729-9_27
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022
DBID 97E
ESBDL
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
DOI 10.1109/LRA.2022.3191200
DatabaseName IEEE Xplore (IEEE)
IEEE Xplore Open Access Journals
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts Professional
DatabaseTitleList Technology Research Database

Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 2377-3766
EndPage 9944
ExternalDocumentID 10_1109_LRA_2022_3191200
9830842
Genre orig-research
GroupedDBID 0R~
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFS
AGQYO
AGSQL
AHBIQ
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
EBS
EJD
ESBDL
IFIPE
IPLJI
JAVBF
KQ8
M43
M~E
O9-
OCL
RIA
RIE
AAYXX
CITATION
RIG
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c333t-c5a46549105916613eded9fc9b83ece54c2c24c7adf83a143bd52ba19fbb8f913
IEDL.DBID RIE
ISSN 2377-3766
IngestDate Sun Jun 29 16:10:37 EDT 2025
Thu Apr 24 22:59:49 EDT 2025
Tue Jul 01 03:54:15 EDT 2025
Wed Aug 27 02:14:02 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 4
Language English
License https://creativecommons.org/licenses/by/4.0/legalcode
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c333t-c5a46549105916613eded9fc9b83ece54c2c24c7adf83a143bd52ba19fbb8f913
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0002-4759-9706
0000-0002-5310-2997
0000-0002-1819-8276
0000-0001-8635-5571
0000-0003-1950-6186
0000-0002-1261-737X
OpenAccessLink https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/document/9830842
PQID 2697566068
PQPubID 4437225
PageCount 8
ParticipantIDs proquest_journals_2697566068
ieee_primary_9830842
crossref_primary_10_1109_LRA_2022_3191200
crossref_citationtrail_10_1109_LRA_2022_3191200
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2022-10-01
PublicationDateYYYYMMDD 2022-10-01
PublicationDate_xml – month: 10
  year: 2022
  text: 2022-10-01
  day: 01
PublicationDecade 2020
PublicationPlace Piscataway
PublicationPlace_xml – name: Piscataway
PublicationTitle IEEE robotics and automation letters
PublicationTitleAbbrev LRA
PublicationYear 2022
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref12
ref15
ref14
ref31
ref30
ref11
ref33
ref10
ref32
ref1
Bluethmann (ref2) 2003; 14
ref16
ref19
ref18
Hirche (ref5) 2003
ref24
ref23
ref26
ref25
ref20
ref22
ref21
ref28
ref27
Rakita (ref17) 2017
ref29
ref8
ref7
ref9
ref4
ref3
ref6
References_xml – ident: ref31
  doi: 10.1201/9781498710411-35
– start-page: 361
  volume-title: Proc. IEEE/ACM 12th Int. Conf. Hum.-Robot Interaction
  year: 2017
  ident: ref17
  article-title: A motion retargeting method for effective mimicry-based teleoperation of robot arms
– ident: ref4
  doi: 10.1109/MRA.2017.2788801
– ident: ref16
  doi: 10.1109/ICRA.2014.6907261
– ident: ref3
  doi: 10.1109/70.258052
– ident: ref8
  doi: 10.1177/154193120104502712
– ident: ref15
  doi: 10.1109/LRA.2017.2737046
– ident: ref6
  doi: 10.1109/MRA.2016.2613281
– ident: ref32
  doi: 10.1080/10447310802205776
– ident: ref12
  doi: 10.1109/TRO.2021.3071530
– ident: ref20
  doi: 10.1016/j.cirp.2014.03.017
– ident: ref7
  doi: 10.1016/j.robot.2015.09.012
– ident: ref14
  doi: 10.1109/ICRA.2018.8461249
– ident: ref24
  doi: 10.1109/ICRA40945.2020.9197220
– ident: ref33
  doi: 10.1177/0278364912464668
– ident: ref9
  doi: 10.1109/IROS.2006.281912
– ident: ref29
  doi: 10.1177/0278364914566516
– volume: 14
  start-page: 179
  issue: 2
  year: 2003
  ident: ref2
  article-title: Robonaut: A robot designed to work with humans in space
  publication-title: Auton. Robots
  doi: 10.1023/A:1022231703061
– volume-title: Proc. Int. Workshop High-Fidelity Telepresence Teleaction jointly with Conf. HUMANOIDS
  year: 2003
  ident: ref5
  article-title: Transparent exploration of remote environments by internet telepresence
– ident: ref10
  doi: 10.1109/ICRA.2019.8794197
– ident: ref1
  doi: 10.1109/ICRA.2016.7487246
– ident: ref23
  doi: 10.1109/TRO.2020.2973099
– ident: ref25
  doi: 10.1177/02783649211017642
– ident: ref22
  doi: 10.1126/scirobotics.aaw0955
– ident: ref30
  doi: 10.1109/MRA.2016.2636366
– ident: ref27
  doi: 10.1109/ICRA48506.2021.9561491
– ident: ref28
  doi: 10.1109/ICRA48506.2021.9561105
– ident: ref13
  doi: 10.1109/ICRA.2019.8793652
– ident: ref18
  doi: 10.1177/0278364917744035
– ident: ref21
  doi: 10.1016/j.robot.2012.07.005
– ident: ref26
  doi: 10.1109/HUMANOIDS.2018.8625047
– ident: ref11
  doi: 10.20965/jrm.2017.p0381
– ident: ref19
  doi: 10.1007/978-3-540-76729-9_27
SSID ssj0001527395
Score 2.2574022
Snippet Teleoperation is a widely adopted strategy to control robotic manipulators executing complex tasks that require highly dexterous movements and critical...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 9937
SubjectTerms bimanual manipulation
Control systems
End effectors
human-robot collaboration
Impedance
Manipulators
Reconfiguration
Robot arms
Robot control
Robot kinematics
Robotics
Robots
Task analysis
Task complexity
Telerobotics and teleoperation
Title A Shared Autonomy Reconfigurable Control Framework for Telemanipulation of Multi-Arm Systems
URI https://ieeexplore.ieee.org/document/9830842
https://www.proquest.com/docview/2697566068
Volume 7
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV07T8MwED61nWDgVRCFUnlgQSJtYiepPVZVqwpRBtRKHZCi2LERArWoJAsDv51zHqUChNgy2CfLd_Hd2fd9B3CpPBEo6RsHfZmLCQoPnThgicN1yMJYh54xFpw8vQsnc_9mESxqcL3Bwmit8-Iz3bWf-Vt-slKZvSrrCc5c7uOBW0czK7BaX_cplklMBNVLpCt6t_cDzP8oxbRUeNRC2LY8T95K5cf5mzuV8T5Mq-UUtSTP3SyVXfX-janxv-s9gL0yuiSDwhwOoaaXR7C7xTnYhIcBsSTNOiGDLM0RDcSmoEvz9JitLY6KDIvqdTKu6rYIBrZkhv7JcmVU_b7IypAcveugrZCS-PwY5uPRbDhxyhYLjmKMpY4KYkuoJmyU5aGrZjrRiTBKSM600oGvqKK-6seJ4SzG2EomAZWxJ4yU3AiPnUBjuVrqUyDUKJxLmaXD8X2dcMkD1XeNRBkSJbSgV21_pEr-cdsG4yXK8xBXRKiwyCosKhXWgqvNjNeCe-OPsU27_5tx5da3oF1pOCp_zreIhqKPUawb8rPfZ53DjpVd1Oy1oZGuM32BsUcqO1Cffow6uel9Ahap2U8
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV07T8MwED4hGICBN6JQwAMLEmkTO07tMUJUBVoGVCQGpCh2bIRALSrJwq_nnEdBgBBbBtuxfGffnX3fdwAnOpBcq9B6aMt8DFBE5KWcZZ4wEYtSEwXWOnDy6CYa3IVX9_x-Ac7mWBhjTJl8Zjrus3zLz6a6cFdlXSmYL0I8cJfQ7oe8Qmt93qg4LjHJm7dIX3aHtzFGgJRiYCoD6kBsX2xPWUzlxwlcmpX-OoyaCVXZJM-dIlcd_f6Nq_G_M96Atdq_JHGlEJuwYCZbsPqFdXAbHmLiaJpNRuIiLzENxAWhE_v0WMwckoqcV_nrpN9kbhF0bckYLZRjy2gqfpGpJSV-10NtITX1-Q7c9S_G5wOvLrLgacZY7mmeOko16fysAI01M5nJpNVSCWa04aGmmoa6l2ZWsBS9K5VxqtJAWqWElQHbhcXJdGL2gFCrsS9ljhAnDE0mlOC651uFYygcoQXdZvkTXTOQu0IYL0kZifgyQYElTmBJLbAWnM57vFbsG3-03XbrP29XL30L2o2Ek3p7viU0kj30Y_1I7P_e6xiWB-PRMBle3lwfwIr7T5XB14bFfFaYQ_REcnVUKuAHeOfbaw
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Shared+Autonomy+Reconfigurable+Control+Framework+for+Telemanipulation+of+Multi-Arm+Systems&rft.jtitle=IEEE+robotics+and+automation+letters&rft.au=Ozdamar%2C+Idil&rft.au=Laghi%2C+Marco&rft.au=Grioli%2C+Giorgio&rft.au=Ajoudani%2C+Arash&rft.date=2022-10-01&rft.pub=IEEE&rft.eissn=2377-3766&rft.volume=7&rft.issue=4&rft.spage=9937&rft.epage=9944&rft_id=info:doi/10.1109%2FLRA.2022.3191200&rft.externalDocID=9830842
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2377-3766&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2377-3766&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2377-3766&client=summon