IoRT enabled gesture mimicking Robotic Hand based on Computer Vision

Human Robot Interaction (HRI) is a multi-model, progressive approach where humans get together with robots to complement one another. The Internet of Robotic Things (IoRT) happens to be an intriguing technology of the modern world, but it becomes immersive when combined with computer vision. IoRT re...

Full description

Saved in:
Bibliographic Details
Published in2024 International Conference on Emerging Trends in Smart Technologies (ICETST) pp. 1 - 6
Main Authors Javeed, Yasir, Mehdi, Hafiz Muhammad
Format Conference Proceeding
LanguageEnglish
Published IEEE 10.10.2024
Subjects
Computer architecture
Computer vision
Gesture
Human Computer Interaction (HCI)
Human Robot Interaction (HRI)
Human-robot interaction
Internet of Robotic Things (IoRT)
Internet of Things (IoT)
MediaPipe
Microcontrollers
OpenCV
Raspberry Pi Pico
Robot sensing systems
Robotic Hand
Sensor systems
Service robots
Weapons
Wearable devices
Wearable sensors
Online AccessGet full text

Cover

More Information
Summary:Human Robot Interaction (HRI) is a multi-model, progressive approach where humans get together with robots to complement one another. The Internet of Robotic Things (IoRT) happens to be an intriguing technology of the modern world, but it becomes immersive when combined with computer vision. IoRT refers to the control of robots over the internet. According to the International Labor Organization (ILO), close to 3 million people die each year due to occupational hazards. Explosives, munition, chemical processing, and mining industries are in the midst of pernicious industries. This paper presents a human gesture-controlled robotic hand that uses MediaPipe and OpenCV libraries to classify gestures and proposes an IoRT architecture. The Cortex M0+ based Raspberry Pi Pico MCU has been used to realize the concept of AI on embedded systems where a worker makes a robotic entity to mimic him while sitting in a safe cabin, eliminating the need for numerous sensors and cumbersome wearables.
DOI:10.1109/ICETST62952.2024.10737931