Robot System Assistant (RoSA): Towards Intuitive Multi-Modal and Multi-Device Human-Robot Interaction

• Published in: Sensors (Basel, Switzerland) Vol. 22; no. 3; p. 923
• Main Authors: Strazdas, Dominykas, Hintz, Jan, Khalifa, Aly, Abdelrahman, Ahmed A., Hempel, Thorsten, Al-Hamadi, Ayoub
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 25.01.2022; MDPI
• Subjects: activity recognition; Artificial intelligence; augmented reality; Collaboration; Communication; Comparative analysis; cooperative systems; facial recognition; gesture recognition; Gestures; human-robot interaction; Humans; Middleware; Robotics; Robots; Rosa; Software; Speech; Work stations; Germany; human-robot interaction; gesture recognition; speech recognition; robot control; interactive systems; augmented reality; cooperative systems; facial recognition; activity recognition

This paper presents an implementation of RoSA, a Robot System Assistant, for safe and intuitive human-machine interaction. The interaction modalities were chosen and previously reviewed using a Wizard of Oz study emphasizing a strong propensity for speech and pointing gestures. Based on these findin...