A Shared Autonomy Reconfigurable Control Framework for Telemanipulation of Multi-Arm Systems
Teleoperation is a widely adopted strategy to control robotic manipulators executing complex tasks that require highly dexterous movements and critical high-level intelligence. Classical teleoperation schemes are based on either joystick control, or on more intuitive interfaces which map directly th...
Saved in:
Published in | IEEE robotics and automation letters Vol. 7; no. 4; pp. 9937 - 9944 |
---|---|
Main Authors | , , , , , |
Format | Journal Article |
Language | English |
Published |
Piscataway
IEEE
01.10.2022
The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
Subjects | |
Online Access | Get full text |
ISSN | 2377-3766 2377-3766 |
DOI | 10.1109/LRA.2022.3191200 |
Cover
Loading…
Abstract | Teleoperation is a widely adopted strategy to control robotic manipulators executing complex tasks that require highly dexterous movements and critical high-level intelligence. Classical teleoperation schemes are based on either joystick control, or on more intuitive interfaces which map directly the user arm motions into one robot arm's motions. These approaches have limits when the execution of a given task requires reconfigurable multiple robotic arm systems. Indeed, the simultaneous teleoperation of two or more robot arms could extend the workspace of the manipulation cell, or increase its total payload, or afford other advantages. In different phases of a reconfigurable multi-arm system, each robot could act as an independent arm, or as one of a pair of cooperating arms, or as one of the fingers of a virtual, large robot hand. This manuscript proposes a novel telemanipulation framework that enables both the individual and combined control of any number of robotic arms. Thanks to the designed control architecture, the human operator can intuitively choose the proposed control modalities and the manipulators that make the task convenient to execute through the user interface. Moreover, through the tele-impedance paradigm, the system can address complex tasks that require physical interaction by letting the robot mimic the arm impedance and position references of the human operator. The proposed framework is validated with 8 subjects controlling 4 Franka Emika Panda robots with 7-DoFs to execute a telemanipulation task. Qualitative results of the experiments show us the promising applicability of our framework. |
---|---|
AbstractList | Teleoperation is a widely adopted strategy to control robotic manipulators executing complex tasks that require highly dexterous movements and critical high-level intelligence. Classical teleoperation schemes are based on either joystick control, or on more intuitive interfaces which map directly the user arm motions into one robot arm's motions. These approaches have limits when the execution of a given task requires reconfigurable multiple robotic arm systems. Indeed, the simultaneous teleoperation of two or more robot arms could extend the workspace of the manipulation cell, or increase its total payload, or afford other advantages. In different phases of a reconfigurable multi-arm system, each robot could act as an independent arm, or as one of a pair of cooperating arms, or as one of the fingers of a virtual, large robot hand. This manuscript proposes a novel telemanipulation framework that enables both the individual and combined control of any number of robotic arms. Thanks to the designed control architecture, the human operator can intuitively choose the proposed control modalities and the manipulators that make the task convenient to execute through the user interface. Moreover, through the tele-impedance paradigm, the system can address complex tasks that require physical interaction by letting the robot mimic the arm impedance and position references of the human operator. The proposed framework is validated with 8 subjects controlling 4 Franka Emika Panda robots with 7-DoFs to execute a telemanipulation task. Qualitative results of the experiments show us the promising applicability of our framework. |
Author | Ozdamar, Idil Grioli, Giorgio Bicchi, Antonio Laghi, Marco Catalano, Manuel G. Ajoudani, Arash |
Author_xml | – sequence: 1 givenname: Idil orcidid: 0000-0002-4759-9706 surname: Ozdamar fullname: Ozdamar, Idil email: iozdamar13@ku.edu.tr organization: Soft Robotics for Human Cooperation and Rehabilitation (SoftBots), Istituto Italiano di Tecnologia, Genoa, Italy – sequence: 2 givenname: Marco orcidid: 0000-0002-1819-8276 surname: Laghi fullname: Laghi, Marco email: marco.laghi89@gmail.com organization: Human-Robot Interfaces and Physical Interaction (HRI2), Istituto Italiano di Tecnologia, Genoa, Italy – sequence: 3 givenname: Giorgio orcidid: 0000-0002-5310-2997 surname: Grioli fullname: Grioli, Giorgio email: giorgio.grioli@gmail.com organization: Soft Robotics for Human Cooperation and Rehabilitation (SoftBots), Istituto Italiano di Tecnologia, Genoa, Italy – sequence: 4 givenname: Arash orcidid: 0000-0002-1261-737X surname: Ajoudani fullname: Ajoudani, Arash email: arash.ajoudani@iit.it organization: Human-Robot Interfaces and Physical Interaction (HRI2), Istituto Italiano di Tecnologia, Genoa, Italy – sequence: 5 givenname: Manuel G. orcidid: 0000-0003-1950-6186 surname: Catalano fullname: Catalano, Manuel G. email: manuel.catalano@iit.it organization: Soft Robotics for Human Cooperation and Rehabilitation (SoftBots), Istituto Italiano di Tecnologia, Genoa, Italy – sequence: 6 givenname: Antonio orcidid: 0000-0001-8635-5571 surname: Bicchi fullname: Bicchi, Antonio email: antonio.bicchi@iit.it organization: Soft Robotics for Human Cooperation and Rehabilitation (SoftBots), Istituto Italiano di Tecnologia, Genoa, Italy |
BookMark | eNp9kM9LwzAUx4NMcM7dBS8Bz5350abNsQynwkTY5k0oafqimW0z0xTZf-_mhogHT-8dvp_35X3O0aB1LSB0ScmEUiJv5ot8wghjE04lZYScoCHjaRrxVIjBr_0MjbtuTQihCUu5TIboJcfLN-WhwnkfXOuaLV6Adq2xr71XZQ146trgXY1nXjXw6fw7Ns7jFdTQqNZu-loF61rsDH7s62Cj3Dd4ue0CNN0FOjWq7mB8nCP0PLtdTe-j-dPdwzSfR5pzHiKdqFgksaQkkVQIyqGCShoty4yDhiTWTLNYp6oyGVc05mWVsFJRacoyM5LyEbo-3N1499FDF4q16327qyyYkGkiBBHZLkUOKe1d13kwxcbbRvltQUmx11jsNBZ7jcVR4w4RfxBtw_e_wStb_wdeHUALAD89MuMkixn_AlrPgao |
CODEN | IRALC6 |
CitedBy_id | crossref_primary_10_1109_ACCESS_2025_3538277 crossref_primary_10_1016_j_robot_2023_104402 crossref_primary_10_1016_j_robot_2024_104725 crossref_primary_10_1007_s11431_024_2779_8 crossref_primary_10_1109_TASE_2024_3350524 |
Cites_doi | 10.1201/9781498710411-35 10.1109/MRA.2017.2788801 10.1109/ICRA.2014.6907261 10.1109/70.258052 10.1177/154193120104502712 10.1109/LRA.2017.2737046 10.1109/MRA.2016.2613281 10.1080/10447310802205776 10.1109/TRO.2021.3071530 10.1016/j.cirp.2014.03.017 10.1016/j.robot.2015.09.012 10.1109/ICRA.2018.8461249 10.1109/ICRA40945.2020.9197220 10.1177/0278364912464668 10.1109/IROS.2006.281912 10.1177/0278364914566516 10.1023/A:1022231703061 10.1109/ICRA.2019.8794197 10.1109/ICRA.2016.7487246 10.1109/TRO.2020.2973099 10.1177/02783649211017642 10.1126/scirobotics.aaw0955 10.1109/MRA.2016.2636366 10.1109/ICRA48506.2021.9561491 10.1109/ICRA48506.2021.9561105 10.1109/ICRA.2019.8793652 10.1177/0278364917744035 10.1016/j.robot.2012.07.005 10.1109/HUMANOIDS.2018.8625047 10.20965/jrm.2017.p0381 10.1007/978-3-540-76729-9_27 |
ContentType | Journal Article |
Copyright | Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022 |
Copyright_xml | – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022 |
DBID | 97E ESBDL RIA RIE AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D |
DOI | 10.1109/LRA.2022.3191200 |
DatabaseName | IEEE Xplore (IEEE) IEEE Xplore Open Access Journals IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional |
DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional |
DatabaseTitleList | Technology Research Database |
Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Engineering |
EISSN | 2377-3766 |
EndPage | 9944 |
ExternalDocumentID | 10_1109_LRA_2022_3191200 9830842 |
Genre | orig-research |
GroupedDBID | 0R~ 97E AAJGR AARMG AASAJ AAWTH ABAZT ABQJQ ABVLG ACGFS AGQYO AGSQL AHBIQ AKJIK AKQYR ALMA_UNASSIGNED_HOLDINGS ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ EBS EJD ESBDL IFIPE IPLJI JAVBF KQ8 M43 M~E O9- OCL RIA RIE AAYXX CITATION RIG 7SC 7SP 8FD JQ2 L7M L~C L~D |
ID | FETCH-LOGICAL-c333t-c5a46549105916613eded9fc9b83ece54c2c24c7adf83a143bd52ba19fbb8f913 |
IEDL.DBID | RIE |
ISSN | 2377-3766 |
IngestDate | Sun Jun 29 16:10:37 EDT 2025 Thu Apr 24 22:59:49 EDT 2025 Tue Jul 01 03:54:15 EDT 2025 Wed Aug 27 02:14:02 EDT 2025 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 4 |
Language | English |
License | https://creativecommons.org/licenses/by/4.0/legalcode |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c333t-c5a46549105916613eded9fc9b83ece54c2c24c7adf83a143bd52ba19fbb8f913 |
Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
ORCID | 0000-0002-4759-9706 0000-0002-5310-2997 0000-0002-1819-8276 0000-0001-8635-5571 0000-0003-1950-6186 0000-0002-1261-737X |
OpenAccessLink | https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/document/9830842 |
PQID | 2697566068 |
PQPubID | 4437225 |
PageCount | 8 |
ParticipantIDs | proquest_journals_2697566068 ieee_primary_9830842 crossref_primary_10_1109_LRA_2022_3191200 crossref_citationtrail_10_1109_LRA_2022_3191200 |
ProviderPackageCode | CITATION AAYXX |
PublicationCentury | 2000 |
PublicationDate | 2022-10-01 |
PublicationDateYYYYMMDD | 2022-10-01 |
PublicationDate_xml | – month: 10 year: 2022 text: 2022-10-01 day: 01 |
PublicationDecade | 2020 |
PublicationPlace | Piscataway |
PublicationPlace_xml | – name: Piscataway |
PublicationTitle | IEEE robotics and automation letters |
PublicationTitleAbbrev | LRA |
PublicationYear | 2022 |
Publisher | IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
Publisher_xml | – name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
References | ref13 ref12 ref15 ref14 ref31 ref30 ref11 ref33 ref10 ref32 ref1 Bluethmann (ref2) 2003; 14 ref16 ref19 ref18 Hirche (ref5) 2003 ref24 ref23 ref26 ref25 ref20 ref22 ref21 ref28 ref27 Rakita (ref17) 2017 ref29 ref8 ref7 ref9 ref4 ref3 ref6 |
References_xml | – ident: ref31 doi: 10.1201/9781498710411-35 – start-page: 361 volume-title: Proc. IEEE/ACM 12th Int. Conf. Hum.-Robot Interaction year: 2017 ident: ref17 article-title: A motion retargeting method for effective mimicry-based teleoperation of robot arms – ident: ref4 doi: 10.1109/MRA.2017.2788801 – ident: ref16 doi: 10.1109/ICRA.2014.6907261 – ident: ref3 doi: 10.1109/70.258052 – ident: ref8 doi: 10.1177/154193120104502712 – ident: ref15 doi: 10.1109/LRA.2017.2737046 – ident: ref6 doi: 10.1109/MRA.2016.2613281 – ident: ref32 doi: 10.1080/10447310802205776 – ident: ref12 doi: 10.1109/TRO.2021.3071530 – ident: ref20 doi: 10.1016/j.cirp.2014.03.017 – ident: ref7 doi: 10.1016/j.robot.2015.09.012 – ident: ref14 doi: 10.1109/ICRA.2018.8461249 – ident: ref24 doi: 10.1109/ICRA40945.2020.9197220 – ident: ref33 doi: 10.1177/0278364912464668 – ident: ref9 doi: 10.1109/IROS.2006.281912 – ident: ref29 doi: 10.1177/0278364914566516 – volume: 14 start-page: 179 issue: 2 year: 2003 ident: ref2 article-title: Robonaut: A robot designed to work with humans in space publication-title: Auton. Robots doi: 10.1023/A:1022231703061 – volume-title: Proc. Int. Workshop High-Fidelity Telepresence Teleaction jointly with Conf. HUMANOIDS year: 2003 ident: ref5 article-title: Transparent exploration of remote environments by internet telepresence – ident: ref10 doi: 10.1109/ICRA.2019.8794197 – ident: ref1 doi: 10.1109/ICRA.2016.7487246 – ident: ref23 doi: 10.1109/TRO.2020.2973099 – ident: ref25 doi: 10.1177/02783649211017642 – ident: ref22 doi: 10.1126/scirobotics.aaw0955 – ident: ref30 doi: 10.1109/MRA.2016.2636366 – ident: ref27 doi: 10.1109/ICRA48506.2021.9561491 – ident: ref28 doi: 10.1109/ICRA48506.2021.9561105 – ident: ref13 doi: 10.1109/ICRA.2019.8793652 – ident: ref18 doi: 10.1177/0278364917744035 – ident: ref21 doi: 10.1016/j.robot.2012.07.005 – ident: ref26 doi: 10.1109/HUMANOIDS.2018.8625047 – ident: ref11 doi: 10.20965/jrm.2017.p0381 – ident: ref19 doi: 10.1007/978-3-540-76729-9_27 |
SSID | ssj0001527395 |
Score | 2.2574022 |
Snippet | Teleoperation is a widely adopted strategy to control robotic manipulators executing complex tasks that require highly dexterous movements and critical... |
SourceID | proquest crossref ieee |
SourceType | Aggregation Database Enrichment Source Index Database Publisher |
StartPage | 9937 |
SubjectTerms | bimanual manipulation Control systems End effectors human-robot collaboration Impedance Manipulators Reconfiguration Robot arms Robot control Robot kinematics Robotics Robots Task analysis Task complexity Telerobotics and teleoperation |
Title | A Shared Autonomy Reconfigurable Control Framework for Telemanipulation of Multi-Arm Systems |
URI | https://ieeexplore.ieee.org/document/9830842 https://www.proquest.com/docview/2697566068 |
Volume | 7 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV07T8MwED61nWDgVRCFUnlgQSJtYiepPVZVqwpRBtRKHZCi2LERArWoJAsDv51zHqUChNgy2CfLd_Hd2fd9B3CpPBEo6RsHfZmLCQoPnThgicN1yMJYh54xFpw8vQsnc_9mESxqcL3Bwmit8-Iz3bWf-Vt-slKZvSrrCc5c7uOBW0czK7BaX_cplklMBNVLpCt6t_cDzP8oxbRUeNRC2LY8T95K5cf5mzuV8T5Mq-UUtSTP3SyVXfX-janxv-s9gL0yuiSDwhwOoaaXR7C7xTnYhIcBsSTNOiGDLM0RDcSmoEvz9JitLY6KDIvqdTKu6rYIBrZkhv7JcmVU_b7IypAcveugrZCS-PwY5uPRbDhxyhYLjmKMpY4KYkuoJmyU5aGrZjrRiTBKSM600oGvqKK-6seJ4SzG2EomAZWxJ4yU3AiPnUBjuVrqUyDUKJxLmaXD8X2dcMkD1XeNRBkSJbSgV21_pEr-cdsG4yXK8xBXRKiwyCosKhXWgqvNjNeCe-OPsU27_5tx5da3oF1pOCp_zreIhqKPUawb8rPfZ53DjpVd1Oy1oZGuM32BsUcqO1Cffow6uel9Ahap2U8 |
linkProvider | IEEE |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV07T8MwED4hGICBN6JQwAMLEmkTO07tMUJUBVoGVCQGpCh2bIRALSrJwq_nnEdBgBBbBtuxfGffnX3fdwAnOpBcq9B6aMt8DFBE5KWcZZ4wEYtSEwXWOnDy6CYa3IVX9_x-Ac7mWBhjTJl8Zjrus3zLz6a6cFdlXSmYL0I8cJfQ7oe8Qmt93qg4LjHJm7dIX3aHtzFGgJRiYCoD6kBsX2xPWUzlxwlcmpX-OoyaCVXZJM-dIlcd_f6Nq_G_M96Atdq_JHGlEJuwYCZbsPqFdXAbHmLiaJpNRuIiLzENxAWhE_v0WMwckoqcV_nrpN9kbhF0bckYLZRjy2gqfpGpJSV-10NtITX1-Q7c9S_G5wOvLrLgacZY7mmeOko16fysAI01M5nJpNVSCWa04aGmmoa6l2ZWsBS9K5VxqtJAWqWElQHbhcXJdGL2gFCrsS9ljhAnDE0mlOC651uFYygcoQXdZvkTXTOQu0IYL0kZifgyQYElTmBJLbAWnM57vFbsG3-03XbrP29XL30L2o2Ek3p7viU0kj30Y_1I7P_e6xiWB-PRMBle3lwfwIr7T5XB14bFfFaYQ_REcnVUKuAHeOfbaw |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+Shared+Autonomy+Reconfigurable+Control+Framework+for+Telemanipulation+of+Multi-Arm+Systems&rft.jtitle=IEEE+robotics+and+automation+letters&rft.au=Ozdamar%2C+Idil&rft.au=Laghi%2C+Marco&rft.au=Grioli%2C+Giorgio&rft.au=Ajoudani%2C+Arash&rft.date=2022-10-01&rft.pub=IEEE&rft.eissn=2377-3766&rft.volume=7&rft.issue=4&rft.spage=9937&rft.epage=9944&rft_id=info:doi/10.1109%2FLRA.2022.3191200&rft.externalDocID=9830842 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2377-3766&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2377-3766&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2377-3766&client=summon |