Remote Extended Reality With Markerless Motion Tracking for Sitting Posture Training

• Published in: IEEE robotics and automation letters Vol. 9; no. 11; pp. 9860 - 9867
• Main Authors: Ai, Xupeng, Agrawal, Sunil K.
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.11.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Extended reality; Impact analysis; markerless motion tracking; Portable computers; postural control; Posture; Protocols; Rehabilitation; Remote control; Remote rehabilitation system; Tracking; Training; virtual reality and interfaces; Webcams; Wrist; Remote Rehabilitation System; Postural Control; Virtual Reality and Interfaces; Markerless Motion Tracking
• ISSN: 2377-3766; 2377-3766
• DOI: 10.1109/LRA.2024.3460412

Dynamic postural control during sitting is essential for functional mobility and daily activities. Extended reality (XR) presents a promising solution for posture training in addressing conventional training limitations related to patient accessibility and ecological validity. We developed a remote XR rehabilitation system with markerless motion tracking for sitting posture training. Forty-two healthy subjects participated in this proof-of-concept pilot study. Each subject completed 24 rounds of multi-directional reach tasks using the system and 24 rounds without it. Motion data were collected via online meetings using built-in camera in the user's laptop. Functional reach test scores were analyzed to assess the impact of the system on motor performance. Four standard questionnaires were used to assess the effects of this system on presence, simulator sickness, engagement, and enjoyment. Our results indicate that the remote XR training system significantly improved functional reach performance and proved highly effective for telerehabilitation. XR interaction also enhanced training engagement and enjoyment. By bridging the spatial gap between patients and therapists, this system enables personalized and engaging home-based intervention. Additionally, it facilitates more natural movements by eliminating body marker constraints and laboratory limitations. This study should serve as a stepping stone to advancing novel remote XR rehabilitation systems.