Benchmarking Agility For Multilegged Terrestrial Robots

In this paper, we present a novel and practical approach for benchmarking agility. We focus on terrestrial, multilegged locomotion in the field of bio-inspired robotics. We define agility as the ability to perform a set of different but specific tasks executed in a fast and efficient manner. This de...

Full description

Saved in:
Bibliographic Details
Published inIEEE transactions on robotics Vol. 35; no. 2; pp. 529 - 535
Main Authors Eckert, Peter, Ijspeert, Auke J.
Format Journal Article
LanguageEnglish
Published New York IEEE 01.04.2019
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects
Online AccessGet full text

Cover

Loading…
Abstract In this paper, we present a novel and practical approach for benchmarking agility. We focus on terrestrial, multilegged locomotion in the field of bio-inspired robotics. We define agility as the ability to perform a set of different but specific tasks executed in a fast and efficient manner. This definition is inspired by the analysis of natural role models, such as dogs and horses as well as robotic systems. An evaluation of existing benchmarks in robotics is done and taken into account in our proposed benchmark. After the general definition, the actual normalized benchmarking values are defined, and measuring methods, as well as an online database for agility score collection and distribution, are presented. To provide a baseline for agile locomotion, various videos of dog-agility competitions were analyzed and agility scores calculated wherever applicable. Finally, validation and implementation of the benchmark are done with different robots directly available to the authors. In conclusion, our benchmark will enable researchers not only to compare existing robots and find out strengths and weaknesses in different design approaches, but also give a tool to define new fitness functions for optimization, learning processes, and future robots developments, intensifying the links between biology and technology even further.
AbstractList In this paper, we present a novel and practical approach for benchmarking agility. We focus on terrestrial, multilegged locomotion in the field of bio-inspired robotics. We define agility as the ability to perform a set of different but specific tasks executed in a fast and efficient manner. This definition is inspired by the analysis of natural role models, such as dogs and horses as well as robotic systems. An evaluation of existing benchmarks in robotics is done and taken into account in our proposed benchmark. After the general definition, the actual normalized benchmarking values are defined, and measuring methods, as well as an online database for agility score collection and distribution, are presented. To provide a baseline for agile locomotion, various videos of dog-agility competitions were analyzed and agility scores calculated wherever applicable. Finally, validation and implementation of the benchmark are done with different robots directly available to the authors. In conclusion, our benchmark will enable researchers not only to compare existing robots and find out strengths and weaknesses in different design approaches, but also give a tool to define new fitness functions for optimization, learning processes, and future robots developments, intensifying the links between biology and technology even further.
Author Eckert, Peter
Ijspeert, Auke J.
Author_xml – sequence: 1
  givenname: Peter
  orcidid: 0000-0003-3569-8528
  surname: Eckert
  fullname: Eckert, Peter
  email: peter.eckert@epfl.ch
  organization: Biorobotics Laboratory, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
– sequence: 2
  givenname: Auke J.
  orcidid: 0000-0003-1417-9980
  surname: Ijspeert
  fullname: Ijspeert, Auke J.
  email: auke.ijspeert@epfl.ch
  organization: Biorobotics Laboratory, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
BookMark eNp9kDFPwzAQRi1UJNrCjsQSiTnhzk4ceywVBaSiSlWZLSdxgkuIi-MO_fekasXAwHC6G753d3oTMupcZwi5RUgQQT5s1quEAoqECiFknl-QMcoUY0i5GA1zltGYgRRXZNL3WwCaSmBjkj-arvz40v7Tdk00a2xrwyFaOB-97dtgW9M0poo2xnvTB291G61d4UJ_TS5r3fbm5tyn5H3xtJm_xMvV8-t8toxLxliIkQGvuGQiRQH1sUohkRbaVJqhKcpa6qKmCJzqKkOeZxXkzIhClrmkecWm5P60d-fd9374QW3d3nfDSUUpsBSpTLMhxU-p0ru-96ZWpQ06WNcFr22rENRRkhokqaMkdZY0gPAH3Hk72Dj8h9ydEGuM-Y0LjkCZYD8vnHMT
CODEN ITREAE
CitedBy_id crossref_primary_10_1109_ACCESS_2021_3136174
crossref_primary_10_1109_TMECH_2022_3190673
crossref_primary_10_1126_scirobotics_adg0279
crossref_primary_10_3233_JIFS_219012
crossref_primary_10_1109_TMECH_2022_3205383
crossref_primary_10_3390_s20226543
crossref_primary_10_1007_s42235_021_0037_8
crossref_primary_10_3390_technologies10030064
crossref_primary_10_34133_2022_9816495
Cites_doi 10.1109/SSRR.2015.7443021
10.1126/science.1146351
10.1109/TRO.2014.2360493
10.1109/MRA.2013.2248310
10.1177/0278364913489205
10.1109/MRA.2007.380653
10.1109/.2005.1507417
10.1109/JOE.2004.833220
10.1016/0966-6362(95)01057-2
10.1109/ICRA.2015.7139629
10.1109/IROS.2016.7758092
10.1242/jeb.00947
10.1109/TMECH.2013.2283537
10.1108/01439910210425568
10.1145/1865909.1865949
10.1109/ICRA.2015.7139918
10.1007/978-3-642-19457-3_42
10.1007/978-3-319-09435-9_28
10.1177/0959651811402275
10.1016/j.jtbi.2009.08.019
10.1016/S0736-5845(98)00017-9
10.1109/ROBOT.2005.1570749
10.1109/ICRA.2015.7139825
10.1016/S1672-6529(07)60032-8
10.1109/ICRA.2013.6631038
10.1007/978-3-319-23778-7_1
10.1109/ICRA.2014.6907476
10.1126/scirobotics.aag2048
10.1177/0278364904050917
10.1109/IROS.2010.5649134
10.1007/s10514-007-9071-6
10.1098/rsif.2015.1089
10.1117/12.851251
10.1109/ICRA.2013.6631041
10.1177/027836498400300205
10.1177/02783640122067570
10.3389/frobt.2018.00067
10.1117/12.2016073
10.1080/02640410500457109
10.1242/jeb.138.1.301
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2019
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2019
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
7SP
7TB
8FD
FR3
JQ2
L7M
L~C
L~D
DOI 10.1109/TRO.2018.2888977
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Mechanical & Transportation Engineering Abstracts
Technology Research Database
Engineering Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Mechanical & Transportation Engineering Abstracts
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Engineering Research Database
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts Professional
DatabaseTitleList Technology Research Database

Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 1941-0468
EndPage 535
ExternalDocumentID 10_1109_TRO_2018_2888977
8610238
Genre orig-research
GrantInformation_xml – fundername: European Community's Seventh Framework
  grantid: 248311
– fundername: Swiss National Science Foundation
– fundername: École Polytechnique Fédérale de Lausanne
  funderid: 10.13039/501100001703
– fundername: National Centre of Competence in Research Robotics
  funderid: 10.13039/501100011021
GroupedDBID .DC
0R~
29I
4.4
5GY
5VS
6IK
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFO
ACIWK
AENEX
AETIX
AGQYO
AGSQL
AHBIQ
AIBXA
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CS3
DU5
EBS
EJD
F5P
HZ~
H~9
IFIPE
IPLJI
JAVBF
LAI
M43
MS~
O9-
OCL
P2P
PQQKQ
RIA
RIE
RNS
VJK
AAYXX
CITATION
RIG
7SC
7SP
7TB
8FD
FR3
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c333t-1306d69384180f180fc8912baeda31ebcf9abf21062ad51675d073e8b9c7927d3
IEDL.DBID RIE
ISSN 1552-3098
IngestDate Mon Jun 30 02:21:25 EDT 2025
Tue Jul 01 00:42:33 EDT 2025
Thu Apr 24 22:58:12 EDT 2025
Wed Aug 27 02:47:32 EDT 2025
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 2
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c333t-1306d69384180f180fc8912baeda31ebcf9abf21062ad51675d073e8b9c7927d3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0003-1417-9980
0000-0003-3569-8528
OpenAccessLink https://infoscience.epfl.ch/record/262845/files/Benchmarking%20Agility%20Preprint.pdf
PQID 2203412945
PQPubID 27625
PageCount 7
ParticipantIDs crossref_citationtrail_10_1109_TRO_2018_2888977
ieee_primary_8610238
proquest_journals_2203412945
crossref_primary_10_1109_TRO_2018_2888977
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2019-April
2019-4-00
20190401
PublicationDateYYYYMMDD 2019-04-01
PublicationDate_xml – month: 04
  year: 2019
  text: 2019-April
PublicationDecade 2010
PublicationPlace New York
PublicationPlace_xml – name: New York
PublicationTitle IEEE transactions on robotics
PublicationTitleAbbrev TRO
PublicationYear 2019
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References jacoff (ref34) 2002; 1
ref13
ref15
ref14
ref52
ref11
ref10
ref17
ref16
ref19
ref18
jacoff (ref32) 2003
ref51
ref50
(ref45) 0
ref42
ref41
(ref2) 0
ref7
heglund (ref49) 1988; 138
ref9
ref3
ref6
ref5
torricelli (ref4) 2014
(ref48) 0
kennel club (ref44) 2014
ref35
ref37
ref36
ref30
ref33
raibert (ref8) 2008; 17
ref1
ref38
shows (ref43) 0
jacoff (ref31) 2014; 3
duperret (ref39) 2016; 109
baisch (ref24) 2011
(ref47) 0
madden (ref27) 2007; 318
ref23
ref26
ref25
ref20
haldane (ref40) 2016; 1
ref22
ref21
ref28
ref29
(ref46) 0
iida (ref12) 2004; 8
References_xml – ident: ref50
  doi: 10.1109/SSRR.2015.7443021
– volume: 318
  start-page: 1094
  year: 2007
  ident: ref27
  article-title: Mobile robots: Motor challenges and materials solutions
  publication-title: Science
  doi: 10.1126/science.1146351
– ident: ref10
  doi: 10.1109/TRO.2014.2360493
– ident: ref37
  doi: 10.1109/MRA.2013.2248310
– year: 0
  ident: ref47
  article-title: Dog-breeds.
– ident: ref6
  doi: 10.1177/0278364913489205
– ident: ref30
  doi: 10.1109/MRA.2007.380653
– ident: ref13
  doi: 10.1109/.2005.1507417
– ident: ref5
  doi: 10.1109/JOE.2004.833220
– ident: ref41
  doi: 10.1016/0966-6362(95)01057-2
– ident: ref18
  doi: 10.1109/ICRA.2015.7139629
– ident: ref9
  doi: 10.1109/IROS.2016.7758092
– ident: ref42
  doi: 10.1242/jeb.00947
– ident: ref26
  doi: 10.1109/TMECH.2013.2283537
– ident: ref33
  doi: 10.1108/01439910210425568
– ident: ref36
  doi: 10.1145/1865909.1865949
– ident: ref16
  doi: 10.1109/ICRA.2015.7139918
– start-page: 715
  year: 2011
  ident: ref24
  article-title: Design and fabrication of the Harvard ambulatory micro-robot
  publication-title: Robot Res (Springer Tracts in Advanced Robotics)
  doi: 10.1007/978-3-642-19457-3_42
– year: 2014
  ident: ref44
  article-title: Judges' Guide to Agility Equipment
  publication-title: Guidebook
– start-page: 320
  year: 2014
  ident: ref4
  article-title: Benchmarking human-like posture and locomotion of humanoid robots: A preliminary scheme
  publication-title: Biomimetic and Biohybrid Systems (Lecture Notes in Computer Science)
  doi: 10.1007/978-3-319-09435-9_28
– ident: ref11
  doi: 10.1177/0959651811402275
– ident: ref21
  doi: 10.1016/j.jtbi.2009.08.019
– ident: ref1
  doi: 10.1016/S0736-5845(98)00017-9
– ident: ref35
  doi: 10.1109/ROBOT.2005.1570749
– ident: ref20
  doi: 10.1109/ICRA.2015.7139825
– ident: ref22
  doi: 10.1016/S1672-6529(07)60032-8
– volume: 1
  start-page: 87
  year: 2002
  ident: ref34
  article-title: Experiences in deploying test arenas for autonomous mobile robots
  publication-title: NIST Special Publication
– year: 0
  ident: ref46
  article-title: Teach your dog to sidestep!
– year: 2003
  ident: ref32
  article-title: Evolution of a performance metric for urban search and rescue robots (2003)
– volume: 8
  start-page: 642
  year: 2004
  ident: ref12
  article-title: Cheap rapid locomotion of a quadruped robot: Self-stabilization of bounding gait
  publication-title: Proc Int Conf Intell Auton Syst
– ident: ref15
  doi: 10.1109/ICRA.2013.6631038
– year: 0
  ident: ref48
  article-title: Dog runs backwards on narrow path.
– volume: 109
  start-page: 3
  year: 2016
  ident: ref39
  article-title: Towards a comparative measure of legged agility
  publication-title: Experimental Robotics IX (Springer Tracts in Advanced Robotics)
  doi: 10.1007/978-3-319-23778-7_1
– ident: ref28
  doi: 10.1109/ICRA.2014.6907476
– volume: 1
  year: 2016
  ident: ref40
  article-title: Robotic vertical jumping agility via series-elastic power modulation
  publication-title: Robotics Science
  doi: 10.1126/scirobotics.aag2048
– ident: ref7
  doi: 10.1177/0278364904050917
– year: 0
  ident: ref2
  article-title: Agility.
– ident: ref14
  doi: 10.1109/IROS.2010.5649134
– ident: ref25
  doi: 10.1007/s10514-007-9071-6
– ident: ref52
  doi: 10.1098/rsif.2015.1089
– volume: 3
  start-page: 3396
  year: 2014
  ident: ref31
  article-title: Test arenas and performance metrics for urban search and rescue robots
  publication-title: Proc IEEE/RSJ Int Conf Intell Robots Syst
– ident: ref19
  doi: 10.1117/12.851251
– ident: ref17
  doi: 10.1109/ICRA.2013.6631041
– volume: 17
  start-page: 10 823
  year: 2008
  ident: ref8
  article-title: BigDog, the rough-terrain quadruped robot
  publication-title: IFAC Proc Volumes (IFAC-PapersOnline)
– ident: ref29
  doi: 10.1177/027836498400300205
– year: 0
  ident: ref43
  article-title: General Regulations for Agility
  publication-title: RuleBook
– ident: ref23
  doi: 10.1177/02783640122067570
– year: 0
  ident: ref45
  article-title: Dogdance.
– ident: ref51
  doi: 10.3389/frobt.2018.00067
– ident: ref38
  doi: 10.1117/12.2016073
– ident: ref3
  doi: 10.1080/02640410500457109
– volume: 138
  start-page: 301
  year: 1988
  ident: ref49
  article-title: Speed, stride frequency and energy cost per stride: how do they change with body size and gait?
  publication-title: J Exp Biol
  doi: 10.1242/jeb.138.1.301
SSID ssj0024903
Score 2.3331962
Snippet In this paper, we present a novel and practical approach for benchmarking agility. We focus on terrestrial, multilegged locomotion in the field of bio-inspired...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 529
SubjectTerms Animals
Benchmark testing
Benchmarks
Dogs
Fitness
Horses
Legged locomotion
Locomotion
Measurement methods
mobile robots
motion analysis
Optimization
Robot kinematics
Robotics
Robots
Sports
Systems analysis
Task analysis
Title Benchmarking Agility For Multilegged Terrestrial Robots
URI https://ieeexplore.ieee.org/document/8610238
https://www.proquest.com/docview/2203412945
Volume 35
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT8MwDLbGTnDgjRgM1AMXJLq1SZslx4GYENJAmoa0W9Uk7pAYK9rjAL-eJG3HU4hDpR6SKvLn1HZifwY4kzREHpHQIMCpH-mQ-ZwFwjdQs0DHQtPIFjj379jNQ3Q7ikc1uFjVwiCiSz7Dln11d_k6V0t7VNbmzBIN8DVYM4FbUav1wasnXBdkyyjm00Dw6koyEO3h4N7mcPEWMeGe8Xe-mCDXU-XHj9hZl94W9Kt1FUklT63lQrbU2zfKxv8ufBs2SzfT6xZ6sQM1nO7CxifywT3oXBoFfXxO3WG51x3bJNlXr5fPPFeUO8HxGLU3RNe9w6qpN8hlvpjvw0Pvenh145dtFHxFKbXN5gOmmaA8CnmQ2UdxERKZok4NUlJlIpWZCf0YSXUcmghCm32PXArVEaSj6QHUp_kUD8EzQpRacxlbpjVMja_BVBqSDJFmqJlqQLuSbKJKjnHb6mKSuFgjEInBIrFYJCUWDThfzXgp-DX-GLtnRbsaV0q1Ac0KvKTcgPOEkMDYZyKi-Oj3Wcewbr4tiiScJtQXsyWeGP9iIU-dYr0DQnjKPg
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT8MwDLZ4HIADr4EYzx64INGtTdosOQJiGrANCW0St6pJ3CEBK4LtAL-eJO3GU4hDpR4SNfLn1HZifwY4lDREHpHQIMCpH-mQ-ZwFwjdQs0DHQtPIFjh3uqzVjy5v49sZOJ7WwiCiSz7Dmn11d_k6V2N7VFbnzBIN8FmYN3Y_JkW11geznnB9kC2nmE8DwSeXkoGo926ubRYXrxET8BmP54sRcl1VfvyKnX1prkBnsrIireS-Nh7Jmnr7Rtr436WvwnLpaHonhWaswQwO12HpE_1gBRqnRkXvHlN3XO6dDGya7KvXzJ89V5b7gIMBaq-Hrn-HVVTvJpf56GUD-s3z3lnLLxsp-IpSatvNB0wzQXkU8iCzj-IiJDJFnRqspMpEKjMT_DGS6jg0MYQ2Ox-5FKohSEPTTZgb5kPcAs8IUWrNZWy51jA13gZTaUgyRJqhZqoK9YlkE1WyjNtmFw-JizYCkRgsEotFUmJRhaPpjKeCYeOPsRUr2um4UqpV2J2Al5Rb8CUhJDAWmogo3v591gEstHqddtK-6F7twKL5jihScnZhbvQ8xj3jbYzkvlOyd_5jzYg
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Benchmarking+Agility+For+Multilegged+Terrestrial+Robots&rft.jtitle=IEEE+transactions+on+robotics&rft.au=Eckert%2C+Peter&rft.au=Ijspeert%2C+Auke+J&rft.date=2019-04-01&rft.pub=The+Institute+of+Electrical+and+Electronics+Engineers%2C+Inc.+%28IEEE%29&rft.issn=1552-3098&rft.eissn=1941-0468&rft.volume=35&rft.issue=2&rft.spage=529&rft_id=info:doi/10.1109%2FTRO.2018.2888977&rft.externalDBID=NO_FULL_TEXT
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1552-3098&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1552-3098&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1552-3098&client=summon