AR‐Enabled Persistent Human–Machine Interfaces via a Scalable Soft Electrode Array

• Published in: Advanced science Vol. 11; no. 7; pp. e2305871 - n/a
• Main Authors: Kim, Hodam, Cha, Ho‐Seung, Kim, Minseon, Lee, Yoon Jae, Yi, Hoon, Lee, Sung Hoon, Ira, Soltis, Kim, Hojoong, Im, Chang‐Hwan, Yeo, Woon‐Hong
• Format: Journal Article
• Language: English
• Published: Germany John Wiley & Sons, Inc 01.02.2024; Wiley
• Subjects: augmented reality; Classification; electrode array; Electrodes; Electromyography; human–machine interface; Interfaces; Machine learning; Signal processing; soft wearable; Stress concentration; Usability; Wearable computers; augmented reality; electrode array; soft wearable; human-machine interface
• ISSN: 2198-3844; 2198-3844
• DOI: 10.1002/advs.202305871

Augmented reality (AR) is a computer graphics technique that creates a seamless interface between the real and virtual worlds. AR usage rapidly spreads across diverse areas, such as healthcare, education, and entertainment. Despite its immense potential, AR interface controls rely on an external joystick, a smartphone, or a fixed camera system susceptible to lighting. Here, an AR‐integrated soft wearable electronic system that detects the gestures of a subject for more intuitive, accurate, and direct control of external systems is introduced. Specifically, a soft, all‐in‐one wearable device includes a scalable electrode array and integrated wireless system to measure electromyograms for real‐time continuous recognition of hand gestures. An advanced machine learning algorithm embedded in the system enables the classification of ten different classes with an accuracy of 96.08%. Compared to the conventional rigid wearables, the multi‐channel soft wearable system offers an enhanced signal‐to‐noise ratio and consistency over multiple uses due to skin conformality. The demonstration of the AR‐integrated soft wearable system for drone control captures the potential of the platform technology to offer numerous human–machine interface opportunities for users to interact remotely with external hardware and software. This paper reports an AR‐integrated soft wearable electronic system that detects the gestures of a subject for more intuitive, accurate, and direct control of external systems. Specifically, the all‐in‐one wearable device includes a scalable electrode array and integrated wireless system to measure electromyograms for real‐time continuous recognition of hand gestures.