Concept and architecture for programming industrial robots using augmented reality with mobile devices like microsoft HoloLens

This paper proposes a concept for human-robot interaction using techniques of virtual and augmented reality on mobile devices like cell phones and tablets or mixed reality devices like the HoloLens. By combining data received from real robots together with the perception and abilities of a human ope...

Full description

Saved in:
Bibliographic Details
Published in2017 22nd IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) pp. 1 - 4
Main Authors Guhl, Jan, Son Tung, Kruger, Jorg
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.09.2017
Subjects
Augmented reality
Computer architecture
HoloLens
Human-robot interaction
Mobile Devices
Mobile handsets
Robot programming
Robot sensing systems
Service robots
Virtual reality
Online AccessGet full text
ISSN1946-0759
DOI10.1109/ETFA.2017.8247749

Cover

More Information
Summary:This paper proposes a concept for human-robot interaction using techniques of virtual and augmented reality on mobile devices like cell phones and tablets or mixed reality devices like the HoloLens. By combining data received from real robots together with the perception and abilities of a human operator innovative applications are imaginable. Visualizing not only the current robot state but also the robots environment captured with different sensors and processed with both machine and human vision can lead to a rising percentage of robot assisted workplaces or robot installations. Since the visualization of and the interaction with the robotic application is not locally restricted new or improved use cases like remote maintenance or faster startup of industrial robots can be realized. Therefore, an architecture split into three functional units and an overview of our implementation is presented.
ISSN:1946-0759
DOI:10.1109/ETFA.2017.8247749