Haptic Teleoperation of Flexible Needles Combining 3D Ultrasound Guidance and Needle Tip Force Feedback

• Published in: IEEE robotics and automation letters Vol. 6; no. 3; pp. 4859 - 4866
• Main Authors: Aggravi, Marco, Estima, Daniel A. L., Krupa, Alexandre, Misra, Sarthak, Pacchierotti, Claudio
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.07.2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Computer Science; Cutting force; Cutting parameters; Feedback; Force; Forearm; Friction; Haptic interfaces; Haptics and haptic interfaces; Human-Computer Interaction; Insertion; Navigation; Needles; Robot sensing systems; Robotics; steerable catheters/needles; Steering; surgical robotics; Target recognition; Teleoperators; Three-dimensional displays; Ultrasonic imaging; Ultrasound
• ISSN: 2377-3766; 2377-3766
• DOI: 10.1109/LRA.2021.3068635

We present a haptic teleoperation system capable of steering flexible needles under ultrasound imaging toward a target. With respect to similar works, this approach enables intuitive control of the needle motion while providing the user with 3D navigation and needle tip cutting force using a combination of kinesthetic and vibrotactile haptic feedback. The needle is tracked during the insertion using a 3D ultrasound probe. A friction estimation algorithm extracts salient information about the cutting force at the needle tip from a force sensor placed at the needle base. A grounded haptic interface enables natural 6-DoF control of the needle motion while providing kinesthetic feedback, and a wearable cutaneous interface on the forearm provides distributed vibrotactile sensations. We carried out a human subject study to validate the insertion system in a gelatine phantom and compare seven different feedback techniques. The best performance was registered when providing navigation cues through kinesthetic feedback and needle tip cutting force through cutaneous vibrotactile feedback. In this modality, results showed an 87% accuracy improvement with respect to providing no haptic feedback at all.