Soft Wearable Haptic Display and Flexible 3D Force Sensor for Teleoperated Surgical Systems

• Published in: Advanced Sensor Research Vol. 3; no. 1
• Main Authors: Thai, Mai Thanh, Davies, James, Nguyen, Chi Cong, Phan, Phuoc Thien, Hoang, Trung Thien, Ji, Adrienne, Zhu, Kefan, Sharma, Bibhu, Nicotra, Emanuele, Vo‐Doan, Tat Thang, Phan, Hoang‐Phuong, Lovell, Nigel Hamilton, Do, Thanh Nho
• Format: Journal Article
• Language: English
• Published: Stanford John Wiley & Sons, Inc 01.01.2024; Wiley-VCH
• Subjects: 3D force sensor; Dissection; endoscopic surgery; Endoscopy; Feedback; Feedforward control; Fingers; Haptic interfaces; Haptics; Hydraulics; Remote control; Remote sensors; Robot arms; Robotics; Robots; Sensors; Signal processing; Silicones; Skin; soft robotics; Strain gauges; telesurgery; Three dimensional motion; wearable haptic display; Wearable technology
• ISSN: 2751-1219; 2751-1219
• DOI: 10.1002/adsr.202300105

Haptic (touch) is important for effective interaction with the surroundings. In teleoperated surgical systems, its absence leads to reduced perception, making delicate tasks difficult and resulting in unexpected damage to surrounding tissues. To enhance safety, a force‐feedback system and haptic device are needed. However, existing haptic prototypes are associated with rigid, bulky, and heavy components, making effective communication with the skin problematic. This paper presents a teleoperated endoscopic surgical system with an integrated 3D force sensor and real‐time haptic feedback. A surgical robotic arm is remotely controlled by a soft haptic glove incorporated 3‐axis cutaneous device and a finger kinesthetic module. The 3D force sensor is constructed from hydraulic filament soft sensors that can induce pressure change under strain. To enable precise motion, the haptic glove is operated by a feedforward controller and a master‐slave architecture. Experiments with human subjects (n = 15) show that cutaneous and kinesthetic feedback significantly improves the user's performance (9.4 out of 10) compared to no haptic feedback (2.27 out of 10). Finally, subjects rank the new system as highly wearable, comfortable, and effective, which is expected to bridge a gap in the surgical field and support the future development of advanced teleoperated systems. This work introduces a teleoperated surgical system with integrated 3D force sensor and a soft wearable haptic display. The new system is expected to bridge a gap in the field of wearable haptic devices and support the future development of remote surgery.