Augmented Reality for Robotics: A Review

Augmented reality (AR) is used to enhance the perception of the real world by integrating virtual objects to an image sequence acquired from various camera technologies. Numerous AR applications in robotics have been developed in recent years. The aim of this paper is to provide an overview of AR re...

Full description

Saved in:
Bibliographic Details
Published inRobotics (Basel) Vol. 9; no. 2; p. 21
Main Authors Makhataeva, Zhanat, Varol, Huseyin
Format Journal Article
LanguageEnglish
Published MDPI AG 01.06.2020
Subjects
Applied research
Augmented reality
Human-computer interaction
human–robot interaction
remote control
robot assisted surgery
Robot control systems
Robotic surgery
robotics
Technology application
teleoperation
Kazakhstan
Online AccessGet full text

Cover

Abstract Augmented reality (AR) is used to enhance the perception of the real world by integrating virtual objects to an image sequence acquired from various camera technologies. Numerous AR applications in robotics have been developed in recent years. The aim of this paper is to provide an overview of AR research in robotics during the five year period from 2015 to 2019. We classified these works in terms of application areas into four categories: (1) Medical robotics: Robot-Assisted surgery (RAS), prosthetics, rehabilitation, and training systems; (2) Motion planning and control: trajectory generation, robot programming, simulation, and manipulation; (3) Human-robot interaction (HRI): teleoperation, collaborative interfaces, wearable robots, haptic interfaces, brain-computer interfaces (BCIs), and gaming; (4) Multi-agent systems: use of visual feedback to remotely control drones, robot swarms, and robots with shared workspace. Recent developments in AR technology are discussed followed by the challenges met in AR due to issues of camera localization, environment mapping, and registration. We explore AR applications in terms of how AR was integrated and which improvements it introduced to corresponding fields of robotics. In addition, we summarize the major limitations of the presented applications in each category. Finally, we conclude our review with future directions of AR research in robotics. The survey covers over 100 research works published over the last five years.
AbstractList Augmented reality (AR) is used to enhance the perception of the real world by integrating virtual objects to an image sequence acquired from various camera technologies. Numerous AR applications in robotics have been developed in recent years. The aim of this paper is to provide an overview of AR research in robotics during the five year period from 2015 to 2019. We classified these works in terms of application areas into four categories: (1) Medical robotics: Robot-Assisted surgery (RAS), prosthetics, rehabilitation, and training systems; (2) Motion planning and control: trajectory generation, robot programming, simulation, and manipulation; (3) Human-robot interaction (HRI): teleoperation, collaborative interfaces, wearable robots, haptic interfaces, brain-computer interfaces (BCIs), and gaming; (4) Multi-agent systems: use of visual feedback to remotely control drones, robot swarms, and robots with shared workspace. Recent developments in AR technology are discussed followed by the challenges met in AR due to issues of camera localization, environment mapping, and registration. We explore AR applications in terms of how AR was integrated and which improvements it introduced to corresponding fields of robotics. In addition, we summarize the major limitations of the presented applications in each category. Finally, we conclude our review with future directions of AR research in robotics. The survey covers over 100 research works published over the last five years.
Audience Academic
Author Varol, Huseyin
Makhataeva, Zhanat
Author_xml – sequence: 1
  givenname: Zhanat
  surname: Makhataeva
  fullname: Makhataeva, Zhanat
– sequence: 2
  givenname: Huseyin
  orcidid: 0000-0002-4042-425X
  surname: Varol
  fullname: Varol, Huseyin
BookMark eNp1kE1LAzEQhoNUsNaevS548bJ2kuxH4m0pVgsFofQeZrNJSdluJLsq_fdGW0QKzmU-eN9nhrkmo853hpBbCg-cS5gFX_vB6V4CA2D0gowZoyItckFHf-orMu37HcSQlIuCjsl99b7dm24wTbI22LrhkFgfkvWJ95hUcf7hzOcNubTY9mZ6yhOyWTxt5i_p6vV5Oa9Wqc4yNqSlZDUUUhtuQRq0umxspkGIzEJupSg5Uo26YAXSXAtecxE7WtOGWoqUT8jyiG087tRbcHsMB-XRqZ-BD1uFIV7WGoWZthaA55KXmdVWSguIrGZlSWvNMbLujqwtRrnrrB8C6r3rtaoKnuXAy0JG1eyo0sH3fTD2dysF9f1cdfbc6MjPHNoNODjfRb5r__V9AQ1igIM
CitedBy_id crossref_primary_10_1007_s41693_024_00138_6
crossref_primary_10_1145_3640008
crossref_primary_10_1016_j_procir_2021_01_088
crossref_primary_10_5937_fme2403506N
crossref_primary_10_3390_s23136073
crossref_primary_10_1115_1_4062658
crossref_primary_10_3390_technologies10010004
crossref_primary_10_1007_s10845_023_02096_2
crossref_primary_10_55267_iadt_07_12011
crossref_primary_10_1007_s11042_025_20711_7
crossref_primary_10_1177_17562872241297554
crossref_primary_10_17660_ActaHortic_2022_1352_81
crossref_primary_10_1016_j_displa_2024_102655
crossref_primary_10_1016_j_jmsy_2022_09_016
crossref_primary_10_3390_jimaging8100255
crossref_primary_10_1109_ACCESS_2023_3317434
crossref_primary_10_7717_peerj_cs_2000
crossref_primary_10_1002_adfm_202502222
crossref_primary_10_1007_s43154_020_00023_4
crossref_primary_10_1061__ASCE_CP_1943_5487_0001047
crossref_primary_10_1109_LCSYS_2021_3086059
crossref_primary_10_1145_3643804
crossref_primary_10_1145_3660243
crossref_primary_10_1186_s12938_022_01020_8
crossref_primary_10_1115_1_4063350
crossref_primary_10_1109_TVCG_2021_3099290
crossref_primary_10_3390_robotics12060163
crossref_primary_10_1016_j_aei_2021_101498
crossref_primary_10_1109_ACCESS_2025_3526757
crossref_primary_10_3390_app10165660
crossref_primary_10_1007_s12652_022_03874_1
crossref_primary_10_1109_MRA_2021_3135760
crossref_primary_10_1016_j_nepr_2025_104263
crossref_primary_10_1016_j_esp_2024_03_001
crossref_primary_10_1016_j_robot_2021_103973
crossref_primary_10_1145_3660649
crossref_primary_10_2478_cait_2021_0009
crossref_primary_10_1039_D1TC02240G
crossref_primary_10_3389_fsurg_2022_1086988
crossref_primary_10_1049_cim2_12085
crossref_primary_10_3934_mbe_2024262
crossref_primary_10_3389_frobt_2020_00104
crossref_primary_10_1007_s12369_023_00968_4
crossref_primary_10_35741_issn_0258_2724_59_2_35
crossref_primary_10_3390_photonics9100701
crossref_primary_10_1109_LRA_2021_3067848
crossref_primary_10_1109_ACCESS_2024_3393473
crossref_primary_10_1007_s12369_025_01219_4
crossref_primary_10_3390_mti4040078
crossref_primary_10_3390_s23104849
crossref_primary_10_1002_rcs_2351
crossref_primary_10_1061_JPSEA2_PSENG_1652
crossref_primary_10_3390_s22207709
crossref_primary_10_3390_bioengineering10111297
crossref_primary_10_3390_app132212129
crossref_primary_10_1109_ACCESS_2024_3439442
crossref_primary_10_1109_TNSRE_2020_3038209
crossref_primary_10_1016_j_mfglet_2023_08_069
crossref_primary_10_3390_jimaging8050145
crossref_primary_10_3389_frobt_2021_724798
crossref_primary_10_1007_s12193_024_00443_y
crossref_primary_10_1109_ACCESS_2024_3371902
crossref_primary_10_3390_s23031409
crossref_primary_10_1145_3705320
crossref_primary_10_3390_educsci12040253
crossref_primary_10_3390_computers10100126
crossref_primary_10_3390_app15063282
crossref_primary_10_1038_s41526_021_00183_3
crossref_primary_10_3390_electronics13061147
crossref_primary_10_3390_technologies8040077
crossref_primary_10_62486_agsalud202450
crossref_primary_10_3390_soilsystems7040088
crossref_primary_10_1016_j_displa_2024_102683
crossref_primary_10_1016_j_spinee_2021_03_018
crossref_primary_10_3390_s22155664
crossref_primary_10_1088_2516_1091_acdc70
crossref_primary_10_3390_en14206642
crossref_primary_10_1002_adfm_202009835
crossref_primary_10_1016_j_actaastro_2022_08_024
crossref_primary_10_1016_j_aei_2023_102265
crossref_primary_10_3390_su152316178
crossref_primary_10_1007_s11042_022_12021_z
crossref_primary_10_1111_anae_15274
crossref_primary_10_3390_s23063262
crossref_primary_10_1145_3696109
crossref_primary_10_1109_MRA_2022_3141973
crossref_primary_10_1007_s10639_022_10912_0
crossref_primary_10_1186_s44247_024_00067_y
crossref_primary_10_1109_TMRB_2023_3237774
crossref_primary_10_1093_iwc_iwab028
crossref_primary_10_3390_act12070302
crossref_primary_10_1007_s11063_023_11215_2
crossref_primary_10_3390_mi15020202
crossref_primary_10_1007_s13748_024_00347_8
crossref_primary_10_1016_j_cag_2025_104178
crossref_primary_10_1080_01691864_2024_2309622
crossref_primary_10_1007_s10055_024_01021_z
crossref_primary_10_1007_s43039_022_00060_1
crossref_primary_10_1016_j_procs_2024_02_021
crossref_primary_10_3390_robotics10010029
crossref_primary_10_3390_s22072725
crossref_primary_10_3390_app12146890
crossref_primary_10_3390_act12080323
crossref_primary_10_1007_s10845_025_02581_w
crossref_primary_10_4204_EPTCS_319_6
crossref_primary_10_1109_IOTM_001_2200262
crossref_primary_10_1145_3648357
crossref_primary_10_1016_j_joen_2024_02_004
crossref_primary_10_1007_s10015_022_00763_w
Cites_doi 10.3171/2017.2.FOCUS177
10.1109/NER.2017.8008377
10.1109/INDIN.2016.7819154
10.1109/MMAR.2017.8046918
10.1109/ICARA.2015.7081126
10.1145/2993369.2993400
10.1109/ACCESS.2019.2940887
10.1016/j.procir.2019.02.097
10.1007/978-3-030-00533-7_14
10.1007/s11701-007-0021-2
10.1117/12.19902
10.1109/ISIC.2016.7579983
10.1109/TVCG.2015.2513408
10.1038/srep27380
10.1007/s00170-019-03941-6
10.1007/s10462-012-9365-8
10.1109/MCG.2002.1046626
10.1016/j.suronc.2011.07.002
10.1109/MRA.2006.1678144
10.1109/ICRoM.2017.8466169
10.1109/ICCE.2017.7889276
10.1145/1476589.1476686
10.1109/38.963459
10.1007/s11701-015-0520-5
10.1016/j.media.2017.01.007
10.1109/VRAIS.1993.380795
10.1162/pres.1997.6.4.355
10.1007/s40436-017-0184-7
10.1016/j.soc.2018.08.002
10.1109/ACCESS.2017.2698164
10.1109/LRA.2018.2864354
10.1002/bjs.9711
10.3389/fnbot.2017.00060
10.1007/s11721-018-0155-z
10.1109/ICAR.2017.8023530
10.1109/WIO.2018.8643463
10.1145/3173386.3173561
10.1109/ISMR.2019.8710185
10.5858/arpa.2017-0189-OA
10.1109/AHS.2015.7231154
10.1109/VS-Games.2018.8493437
10.1145/3351180.3351204
10.1145/3171221.3171251
10.1016/j.cirp.2012.05.010
10.1016/j.rcim.2019.101820
10.1109/ROBIO.2017.8324617
10.1007/978-3-030-32254-0_9
10.1016/j.procs.2017.01.183
10.1007/s00423-014-1256-9
10.1109/THMS.2016.2611998
10.1109/IROS.2017.8206103
10.1007/978-3-319-22698-9_15
10.1007/s00779-015-0844-1
10.1109/ETFA.2017.8247749
10.1093/oso/9780195075557.003.0021
10.1111/bju.14549
10.4218/etrij.2017-0047
10.1109/ROMAN.2016.7745108
10.1109/LRA.2017.2700059
10.1007/s10606-015-9232-7
10.1016/j.media.2016.06.021
10.1016/j.aei.2007.08.005
10.4103/1008-682X.166436
10.1109/MCS.2016.2602090
10.1145/3171221.3171253
10.1109/TASE.2014.2376492
10.1007/s40436-015-0131-4
10.1016/j.procir.2016.11.183
10.1109/TMRB.2019.2957061
10.3390/s17102234
10.1109/SII.2019.8700332
10.1111/bju.12704
10.1109/THMS.2017.2782490
10.1145/192161.192199
10.1109/RCAR.2016.7784014
10.1007/s00266-017-0900-5
10.1002/rcs.1754
10.1007/s40436-019-00283-0
10.1016/j.ejcts.2004.02.001
10.1109/IROS.2018.8593700
10.1109/ICARM.2017.8273199
10.1037/e477812004-001
10.1109/INDIN.2014.6945523
10.1177/0018720816644364
10.1109/IROS.2018.8594482
10.1049/htl.2018.5065
10.1109/ICRA.2019.8794263
10.1109/HRI.2019.8673306
10.1016/j.jcms.2015.10.024
10.1109/RTCSA.2018.00033
10.1109/ICRA.2018.8462837
10.1016/j.procir.2017.03.154
10.4218/etrij.16.0115.0610
ContentType Journal Article
Copyright COPYRIGHT 2020 MDPI AG
Copyright_xml – notice: COPYRIGHT 2020 MDPI AG
DBID AAYXX
CITATION
DOA
DOI 10.3390/robotics9020021
DatabaseName CrossRef
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
DatabaseTitleList CrossRef
Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ Directory of Open Access Journals
  url: https://www.doaj.org/
  sourceTypes: Open Website
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 2218-6581
ExternalDocumentID oai_doaj_org_article_a4cff00359374fcf99f0aa2b2771bc3a
A634503769
10_3390_robotics9020021
GeographicLocations Kazakhstan
GeographicLocations_xml – name: Kazakhstan
GroupedDBID 5VS
8FE
8FG
AAYXX
ABJCF
ABUWG
ADBBV
ADMLS
AFKRA
ALMA_UNASSIGNED_HOLDINGS
ARAPS
AZQEC
BCNDV
BENPR
BGLVJ
BPHCQ
CCPQU
CITATION
DWQXO
GNUQQ
GROUPED_DOAJ
HCIFZ
IAO
K6V
K7-
KQ8
L6V
M7S
MODMG
M~E
OK1
P62
PHGZM
PHGZT
PIMPY
PQQKQ
PROAC
PTHSS
PQGLB
PUEGO
ID FETCH-LOGICAL-c442t-792b069ce3f09eafc7df4c0884f05f9873a1cac626a15c83b38ac61b1d1f1a13
IEDL.DBID DOA
ISSN 2218-6581
IngestDate Wed Aug 27 01:30:48 EDT 2025
Tue Jun 17 20:41:43 EDT 2025
Tue Jul 01 01:46:20 EDT 2025
Thu Apr 24 23:13:13 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 2
Language English
License https://creativecommons.org/licenses/by/4.0
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c442t-792b069ce3f09eafc7df4c0884f05f9873a1cac626a15c83b38ac61b1d1f1a13
ORCID 0000-0002-4042-425X
OpenAccessLink https://doaj.org/article/a4cff00359374fcf99f0aa2b2771bc3a
ParticipantIDs doaj_primary_oai_doaj_org_article_a4cff00359374fcf99f0aa2b2771bc3a
gale_infotracmisc_A634503769
crossref_primary_10_3390_robotics9020021
crossref_citationtrail_10_3390_robotics9020021
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2020-06-01
PublicationDateYYYYMMDD 2020-06-01
PublicationDate_xml – month: 06
  year: 2020
  text: 2020-06-01
  day: 01
PublicationDecade 2020
PublicationTitle Robotics (Basel)
PublicationYear 2020
Publisher MDPI AG
Publisher_xml – name: MDPI AG
References Diana (ref_43) 2015; 102
Lin (ref_51) 2016; 44
ref_94
ref_93
Welch (ref_8) 2002; 22
Chowriappa (ref_44) 2015; 115
Sheridan (ref_112) 2016; 58
Liu (ref_48) 2015; 9
ref_13
ref_98
ref_97
ref_96
ref_95
ref_18
Bodner (ref_26) 2004; 25
ref_17
(ref_11) 2015; 43
Madhavan (ref_58) 2017; 42
Talamali (ref_122) 2019; 6
Brizzi (ref_39) 2017; 48
Valentini (ref_119) 2018; 12
ref_25
Clemente (ref_92) 2016; 47
ref_120
ref_22
ref_21
ref_20
ref_121
Bernhardt (ref_57) 2017; 37
ref_29
ref_28
ref_27
Yew (ref_38) 2017; 61
Nee (ref_15) 2012; 61
ref_71
Lee (ref_73) 2016; 38
ref_79
ref_78
ref_76
ref_75
ref_74
Dickey (ref_50) 2016; 18
ref_83
Kehoe (ref_3) 2015; 12
ref_82
ref_81
Quero (ref_61) 2019; 28
ref_80
Wang (ref_52) 2017; 13
ref_89
Azuma (ref_4) 1997; 6
ref_84
Pessaux (ref_47) 2015; 400
Teitel (ref_19) 1990; Volume 1256
Hanna (ref_60) 2018; 142
Meli (ref_106) 2018; 3
Zhou (ref_53) 2017; 41
ref_54
Avalle (ref_88) 2019; 7
Azuma (ref_5) 2001; 21
Behzadan (ref_37) 2008; 22
Qian (ref_63) 2020; 2
Kundu (ref_70) 2017; 105
Nicolau (ref_14) 2011; 20
ref_59
Mourtzis (ref_99) 2017; 63
Pai (ref_72) 2016; 6
ref_69
ref_68
Porpiglia (ref_56) 2019; 123
ref_67
ref_66
ref_65
ref_64
Petit (ref_109) 2018; 26
ref_62
Omidshafiei (ref_116) 2016; 36
Bailey (ref_24) 2006; 13
Gurevich (ref_90) 2015; 24
ref_115
ref_114
ref_117
ref_36
ref_35
ref_34
ref_33
ref_32
Qian (ref_55) 2018; 5
Zeng (ref_108) 2017; 11
ref_111
ref_31
ref_110
ref_30
ref_113
Lee (ref_42) 2018; 40
Lv (ref_91) 2015; 19
Hockstein (ref_2) 2007; 1
Ong (ref_87) 2020; 8
Reina (ref_118) 2017; 2
Chatzopoulos (ref_16) 2017; 5
Marchand (ref_12) 2015; 22
ref_104
ref_103
ref_105
ref_107
Ni (ref_77) 2017; 5
ref_46
ref_45
Milgram (ref_23) 1994; 77
ref_100
ref_41
ref_102
ref_40
ref_101
ref_1
Mourtzis (ref_85) 2019; 79
Navab (ref_49) 2016; 33
Ong (ref_86) 2020; 61
ref_9
Wang (ref_10) 2016; 4
ref_7
ref_6
References_xml – ident: ref_9
– ident: ref_74
– ident: ref_80
– volume: 42
  start-page: E3
  year: 2017
  ident: ref_58
  article-title: Augmented-reality integrated robotics in neurosurgery: Are We There Yet?
  publication-title: Neurosurg. Focus
  doi: 10.3171/2017.2.FOCUS177
– ident: ref_107
  doi: 10.1109/NER.2017.8008377
– ident: ref_28
  doi: 10.1109/INDIN.2016.7819154
– ident: ref_97
  doi: 10.1109/MMAR.2017.8046918
– ident: ref_65
– ident: ref_45
  doi: 10.1109/ICARA.2015.7081126
– ident: ref_41
  doi: 10.1145/2993369.2993400
– ident: ref_71
– volume: 7
  start-page: 132343
  year: 2019
  ident: ref_88
  article-title: An Augmented Reality System to Support Fault Visualization in Industrial Robotic Tasks
  publication-title: IEEE Access
  doi: 10.1109/ACCESS.2019.2940887
– volume: 79
  start-page: 574
  year: 2019
  ident: ref_85
  article-title: Warehouse Design and Operation using Augmented Reality technology: A Papermaking Industry Case Study
  publication-title: Procedia Cirp
  doi: 10.1016/j.procir.2019.02.097
– ident: ref_117
  doi: 10.1007/978-3-030-00533-7_14
– volume: 1
  start-page: 113
  year: 2007
  ident: ref_2
  article-title: A history of robots: From science fiction to surgical robotics
  publication-title: J. Rob. Surg.
  doi: 10.1007/s11701-007-0021-2
– volume: Volume 1256
  start-page: 168
  year: 1990
  ident: ref_19
  article-title: The Eyephone: A head-mounted stereo display
  publication-title: Stereoscopic Displays and Applications
  doi: 10.1117/12.19902
– ident: ref_68
  doi: 10.1109/ISIC.2016.7579983
– ident: ref_114
– ident: ref_31
– volume: 22
  start-page: 2633
  year: 2015
  ident: ref_12
  article-title: Pose estimation for augmented reality: A hands-on survey
  publication-title: IEEE Trans. Visual Comput. Graphics
  doi: 10.1109/TVCG.2015.2513408
– ident: ref_27
– ident: ref_120
– volume: 6
  start-page: 27380
  year: 2016
  ident: ref_72
  article-title: Virtual planning, control, and machining for a modular-based automated factory operation in an augmented reality environment
  publication-title: Sci. Rep.
  doi: 10.1038/srep27380
– ident: ref_83
– ident: ref_13
– ident: ref_84
  doi: 10.1007/s00170-019-03941-6
– volume: 43
  start-page: 55
  year: 2015
  ident: ref_11
  article-title: Visual simultaneous localization and mapping: A survey
  publication-title: Artif. Intell. Rev.
  doi: 10.1007/s10462-012-9365-8
– volume: 22
  start-page: 24
  year: 2002
  ident: ref_8
  article-title: Motion tracking survey
  publication-title: IEEE Comput. Graphics Appl.
  doi: 10.1109/MCG.2002.1046626
– volume: 20
  start-page: 189
  year: 2011
  ident: ref_14
  article-title: Augmented reality in laparoscopic surgical oncology
  publication-title: Surgical Oncol.
  doi: 10.1016/j.suronc.2011.07.002
– volume: 13
  start-page: 99
  year: 2006
  ident: ref_24
  article-title: Simultaneous Localization and Mapping: Part I
  publication-title: IEEE Robot. Autom. Mag.
  doi: 10.1109/MRA.2006.1678144
– ident: ref_76
  doi: 10.1109/ICRoM.2017.8466169
– ident: ref_94
  doi: 10.1109/ICCE.2017.7889276
– ident: ref_18
  doi: 10.1145/1476589.1476686
– ident: ref_30
– volume: 21
  start-page: 34
  year: 2001
  ident: ref_5
  article-title: Recent advances in augmented reality
  publication-title: IEEE Comput. Graphics Appl.
  doi: 10.1109/38.963459
– volume: 9
  start-page: 223
  year: 2015
  ident: ref_48
  article-title: Augmented reality and cone beam CT guidance for transoral robotic surgery
  publication-title: J. Robot. Surg.
  doi: 10.1007/s11701-015-0520-5
– volume: 37
  start-page: 66
  year: 2017
  ident: ref_57
  article-title: The status of augmented reality in laparoscopic surgery as of 2016
  publication-title: Med. Image Anal.
  doi: 10.1016/j.media.2017.01.007
– ident: ref_22
  doi: 10.1109/VRAIS.1993.380795
– ident: ref_121
– volume: 6
  start-page: 355
  year: 1997
  ident: ref_4
  article-title: A survey of augmented reality
  publication-title: Presence: Teleoperators Virtual Env.
  doi: 10.1162/pres.1997.6.4.355
– volume: 5
  start-page: 191
  year: 2017
  ident: ref_77
  article-title: Haptic and visual augmented reality interface for programming welding robots
  publication-title: Adv. Manuf.
  doi: 10.1007/s40436-017-0184-7
– volume: 28
  start-page: 31
  year: 2019
  ident: ref_61
  article-title: Virtual and augmented reality in oncologic liver surgery
  publication-title: Surg. Oncol. Clin.
  doi: 10.1016/j.soc.2018.08.002
– volume: 5
  start-page: 6917
  year: 2017
  ident: ref_16
  article-title: Mobile augmented reality survey: From where we are to where we go
  publication-title: IEEE Access
  doi: 10.1109/ACCESS.2017.2698164
– volume: 3
  start-page: 4297
  year: 2018
  ident: ref_106
  article-title: Combining wearable finger haptics and Augmented Reality: User evaluation using an external camera and the Microsoft HoloLens
  publication-title: IEEE Robot. Autom. Lett.
  doi: 10.1109/LRA.2018.2864354
– volume: 102
  start-page: e15
  year: 2015
  ident: ref_43
  article-title: Robotic surgery
  publication-title: Br. J. Surg.
  doi: 10.1002/bjs.9711
– volume: 11
  start-page: 60
  year: 2017
  ident: ref_108
  article-title: Closed-loop hybrid gaze brain-machine interface based robotic arm control with augmented reality feedback
  publication-title: Front. Neurorobotics
  doi: 10.3389/fnbot.2017.00060
– volume: 12
  start-page: 245
  year: 2018
  ident: ref_119
  article-title: Kilogrid: A novel experimental environment for the kilobot robot
  publication-title: Swarm Intell.
  doi: 10.1007/s11721-018-0155-z
– ident: ref_6
– ident: ref_95
  doi: 10.1109/ICAR.2017.8023530
– ident: ref_33
  doi: 10.1109/WIO.2018.8643463
– ident: ref_81
– volume: 26
  start-page: 1608
  year: 2018
  ident: ref_109
  article-title: Towards BCI-based Interfaces for Augmented Reality: Feasibility, Design and Evaluation
  publication-title: IEEE Trans. Vis. Comput. Graph.
– ident: ref_111
  doi: 10.1145/3173386.3173561
– ident: ref_46
  doi: 10.1109/ISMR.2019.8710185
– volume: 142
  start-page: 638
  year: 2018
  ident: ref_60
  article-title: Augmented reality technology using Microsoft HoloLens in anatomic pathology
  publication-title: Arch. Pathol. Lab. Med.
  doi: 10.5858/arpa.2017-0189-OA
– ident: ref_115
  doi: 10.1109/AHS.2015.7231154
– ident: ref_36
– ident: ref_25
  doi: 10.1109/VS-Games.2018.8493437
– ident: ref_89
  doi: 10.1145/3351180.3351204
– ident: ref_103
  doi: 10.1145/3171221.3171251
– volume: 61
  start-page: 657
  year: 2012
  ident: ref_15
  article-title: Augmented reality applications in design and manufacturing
  publication-title: CIRP Annals
  doi: 10.1016/j.cirp.2012.05.010
– volume: 61
  start-page: 101820
  year: 2020
  ident: ref_86
  article-title: Augmented reality-assisted robot programming system for industrial applications
  publication-title: Robot. Comput. Integr. Manuf.
  doi: 10.1016/j.rcim.2019.101820
– ident: ref_105
  doi: 10.1109/ROBIO.2017.8324617
– ident: ref_32
– ident: ref_62
  doi: 10.1007/978-3-030-32254-0_9
– ident: ref_113
– volume: 105
  start-page: 27
  year: 2017
  ident: ref_70
  article-title: Scanning camera and augmented reality based localization of omnidirectional robot for indoor application
  publication-title: Procedia Comput. Sci.
  doi: 10.1016/j.procs.2017.01.183
– volume: 400
  start-page: 381
  year: 2015
  ident: ref_47
  article-title: Towards cybernetic surgery: Robotic and augmented reality-assisted liver segmentectomy
  publication-title: Langenbeck’s Arch. Surg.
  doi: 10.1007/s00423-014-1256-9
– volume: 47
  start-page: 583
  year: 2016
  ident: ref_92
  article-title: Humans can integrate augmented reality feedback in their sensorimotor control of a robotic hand
  publication-title: IEEE Trans. Hum. Mach. Syst.
  doi: 10.1109/THMS.2016.2611998
– ident: ref_98
  doi: 10.1109/IROS.2017.8206103
– ident: ref_64
  doi: 10.1007/978-3-319-22698-9_15
– volume: 19
  start-page: 551
  year: 2015
  ident: ref_91
  article-title: Touch-less interactive augmented reality game on vision-based wearable device
  publication-title: Pers. Ubiquitous Comput.
  doi: 10.1007/s00779-015-0844-1
– ident: ref_75
  doi: 10.1109/ETFA.2017.8247749
– ident: ref_20
  doi: 10.1093/oso/9780195075557.003.0021
– volume: 123
  start-page: 834
  year: 2019
  ident: ref_56
  article-title: Augmented-reality robot-assisted radical prostatectomy using hyper-accuracy three-dimensional reconstruction (HA 3D) technology: A radiological and pathological study
  publication-title: BJU Int.
  doi: 10.1111/bju.14549
– volume: 40
  start-page: 246
  year: 2018
  ident: ref_42
  article-title: Robust Multithreaded Object Tracker through Occlusions for Spatial Augmented Reality
  publication-title: Etri J.
  doi: 10.4218/etrij.2017-0047
– ident: ref_67
  doi: 10.1109/ROMAN.2016.7745108
– volume: 2
  start-page: 1755
  year: 2017
  ident: ref_118
  article-title: ARK: Augmented reality for Kilobots
  publication-title: IEEE Robot. Auto. Lett.
  doi: 10.1109/LRA.2017.2700059
– volume: 24
  start-page: 527
  year: 2015
  ident: ref_90
  article-title: Design and implementation of teleadvisor: A projection-based augmented reality system for remote collaboration
  publication-title: Comput. Support. Coop. Work. (Cscw)
  doi: 10.1007/s10606-015-9232-7
– volume: 33
  start-page: 64
  year: 2016
  ident: ref_49
  article-title: Personalized, relevance-based multimodal robotic imaging and augmented reality for computer assisted interventions
  publication-title: Med Image Anal.
  doi: 10.1016/j.media.2016.06.021
– ident: ref_66
– volume: 6
  start-page: 30
  year: 2019
  ident: ref_122
  article-title: Sophisticated Collective Foraging with Minimalist Agents: A Swarm Robotics Test
  publication-title: Swarm Intell.
– ident: ref_17
– volume: 22
  start-page: 90
  year: 2008
  ident: ref_37
  article-title: General-purpose modular hardware and software framework for mobile outdoor augmented reality applications in engineering
  publication-title: Adv. Eng. Inform.
  doi: 10.1016/j.aei.2007.08.005
– volume: 18
  start-page: 732
  year: 2016
  ident: ref_50
  article-title: Augmented reality assisted surgery: A urologic training tool
  publication-title: Asian J. Androl.
  doi: 10.4103/1008-682X.166436
– volume: 36
  start-page: 65
  year: 2016
  ident: ref_116
  article-title: Measurable augmented reality for prototyping cyberphysical systems: A robotics platform to aid the hardware prototyping and performance testing of algorithms
  publication-title: IEEE Control. Syst. Mag.
  doi: 10.1109/MCS.2016.2602090
– ident: ref_101
  doi: 10.1145/3171221.3171253
– volume: 12
  start-page: 398
  year: 2015
  ident: ref_3
  article-title: A survey of research on cloud robotics and automation
  publication-title: IEEE Trans. Autom. Sci. Eng.
  doi: 10.1109/TASE.2014.2376492
– volume: 4
  start-page: 1
  year: 2016
  ident: ref_10
  article-title: A comprehensive survey of augmented reality assembly research
  publication-title: Adv. Manuf.
  doi: 10.1007/s40436-015-0131-4
– ident: ref_7
– volume: 61
  start-page: 305
  year: 2017
  ident: ref_38
  article-title: Immersive augmented reality environment for the teleoperation of maintenance robots
  publication-title: Procedia Cirp
  doi: 10.1016/j.procir.2016.11.183
– volume: 2
  start-page: 1
  year: 2020
  ident: ref_63
  article-title: A Review of Augmented Reality in Robotic-Assisted Surgery
  publication-title: IEEE Trans. Med Robot. Bionics
  doi: 10.1109/TMRB.2019.2957061
– ident: ref_69
  doi: 10.3390/s17102234
– ident: ref_34
– ident: ref_100
  doi: 10.1109/SII.2019.8700332
– ident: ref_82
– volume: 115
  start-page: 336
  year: 2015
  ident: ref_44
  article-title: Augmented-reality-based skills training for robot-assisted urethrovesical anastomosis: A multi-institutional randomised controlled trial
  publication-title: BJU Int.
  doi: 10.1111/bju.12704
– ident: ref_40
– volume: 48
  start-page: 197
  year: 2017
  ident: ref_39
  article-title: Effects of augmented reality on the performance of teleoperated industrial assembly tasks in a robotic embodiment
  publication-title: IEEE Trans. Hum. Mach. Syst.
  doi: 10.1109/THMS.2017.2782490
– volume: 77
  start-page: 1321
  year: 1994
  ident: ref_23
  article-title: A taxonomy of mixed reality visual displays
  publication-title: Ieice Trans. Inf. Syst.
– ident: ref_35
  doi: 10.1145/192161.192199
– ident: ref_96
  doi: 10.1109/RCAR.2016.7784014
– volume: 41
  start-page: 1228
  year: 2017
  ident: ref_53
  article-title: Robot-assisted surgery for mandibular angle split osteotomy using augmented reality: Preliminary results on clinical animal experiment
  publication-title: Aesthetic Plast. Surg.
  doi: 10.1007/s00266-017-0900-5
– ident: ref_29
– ident: ref_54
– volume: 13
  start-page: e1754
  year: 2017
  ident: ref_52
  article-title: Video see-through augmented reality for oral and maxillofacial surgery
  publication-title: Int. J. Med Robot. Comput. Assist. Surg.
  doi: 10.1002/rcs.1754
– volume: 8
  start-page: 40
  year: 2020
  ident: ref_87
  article-title: AR-assisted robot welding programming
  publication-title: Adv. Manuf.
  doi: 10.1007/s40436-019-00283-0
– volume: 25
  start-page: 844
  year: 2004
  ident: ref_26
  article-title: First experiences with the da Vinci operating robot in thoracic surgery
  publication-title: Eur. J. -Cardio-Thorac. Surg.
  doi: 10.1016/j.ejcts.2004.02.001
– ident: ref_79
  doi: 10.1109/IROS.2018.8593700
– ident: ref_93
  doi: 10.1109/ICARM.2017.8273199
– ident: ref_21
  doi: 10.1037/e477812004-001
– ident: ref_1
  doi: 10.1109/INDIN.2014.6945523
– volume: 58
  start-page: 525
  year: 2016
  ident: ref_112
  article-title: Human-robot interaction: Status and challenges
  publication-title: Hum. Factors
  doi: 10.1177/0018720816644364
– ident: ref_104
  doi: 10.1109/IROS.2018.8594482
– volume: 5
  start-page: 194
  year: 2018
  ident: ref_55
  article-title: ARssist: Augmented reality on a head-mounted display for the first assistant in robotic surgery
  publication-title: Healthc. Technol. Lett.
  doi: 10.1049/htl.2018.5065
– ident: ref_59
  doi: 10.1109/ICRA.2019.8794263
– ident: ref_102
  doi: 10.1109/HRI.2019.8673306
– volume: 44
  start-page: 215
  year: 2016
  ident: ref_51
  article-title: Mandibular angle split osteotomy based on a novel augmented reality navigation using specialized robot-assisted arms—A feasibility study
  publication-title: J. Cranio Maxillofac. Surg.
  doi: 10.1016/j.jcms.2015.10.024
– ident: ref_110
  doi: 10.1109/RTCSA.2018.00033
– ident: ref_78
  doi: 10.1109/ICRA.2018.8462837
– volume: 63
  start-page: 46
  year: 2017
  ident: ref_99
  article-title: Augmented reality application to support remote maintenance as a service in the robotics industry
  publication-title: Procedia Cirp
  doi: 10.1016/j.procir.2017.03.154
– volume: 38
  start-page: 337
  year: 2016
  ident: ref_73
  article-title: Data-Driven Kinematic Control for Robotic Spatial Augmented Reality System with Loose Kinematic Specifications
  publication-title: ETRI J.
  doi: 10.4218/etrij.16.0115.0610
SSID ssj0000913861
Score 2.5621471
SecondaryResourceType review_article
Snippet Augmented reality (AR) is used to enhance the perception of the real world by integrating virtual objects to an image sequence acquired from various camera...
SourceID doaj
gale
crossref
SourceType Open Website
Aggregation Database
Enrichment Source
Index Database
StartPage 21
SubjectTerms Applied research
Augmented reality
Human-computer interaction
human–robot interaction
remote control
robot assisted surgery
Robot control systems
Robotic surgery
robotics
Technology application
teleoperation
Title Augmented Reality for Robotics: A Review
URI https://doaj.org/article/a4cff00359374fcf99f0aa2b2771bc3a
Volume 9
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3PS8MwFA4yL3oQf-J0jh487FKXNGnTeKuyMQSHjAm7leQ18SKbjO3_9yWtowrixWNLStL3kve-LyTfI-Q2zSvM8hmPmWBVLExGY6W0i5nR1iWGKxEuhT1Ps8mreFqki1apL38mrJYHrg031AKcC0JzXAoHTilHtU5MIiUzwAM0wpzXIlMhBivG84zVWj4cef1wvTIrL3ysaDiW8C0NBbX-Jia3ssv4mBw1sDAq6uGckD27PCWHLbHAMzIotm9BQbOKZjag5wgBZzRreryPiqje6D8n8_Fo_jiJmzoHMQiRbGKpEkMzBZY7qqx2ICsnAJe_cDR1KpdcM9CA1EOzFHJueI5PzLCKOaYZvyCd5WppL0mE2Zfn0uaVohYjoFTAtDESAHEZRyjWJXdff11CowHuS1G8l8gFvJnKH2bqksHug49a_uL3pg_ejLtmXrc6vEBvlo03y7-82SU974TSry4cGOBch7LIuEgpRkJ19R99XJODxJPmsJXSI53NemtvEFlsTJ_sP4ymL7N-mEyfI3jMjA
linkProvider Directory of Open Access Journals
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Augmented+Reality+for+Robotics%3A+A+Review&rft.jtitle=Robotics+%28Basel%29&rft.au=Zhanat+Makhataeva&rft.au=Huseyin+Atakan+Varol&rft.date=2020-06-01&rft.pub=MDPI+AG&rft.eissn=2218-6581&rft.volume=9&rft.issue=2&rft.spage=21&rft_id=info:doi/10.3390%2Frobotics9020021&rft.externalDBID=DOA&rft.externalDocID=oai_doaj_org_article_a4cff00359374fcf99f0aa2b2771bc3a
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2218-6581&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2218-6581&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2218-6581&client=summon