Vision-based haptic feedback for capsule endoscopy navigation: a proof of concept

• Published in: Journal of micro-bio robotics Vol. 11; no. 1-4; pp. 35 - 45
• Main Authors: Mura, Marco, Abu-Kheil, Yasmeen, Ciuti, Gastone, Visentini-Scarzanella, Marco, Menciassi, Arianna, Dario, Paolo, Dias, Jorge, Seneviratne, Lakmal
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.06.2016
• Subjects: Electronics and Microelectronics; Engineering; Instrumentation; Machines; Manufacturing; Nanotechnology; Processes; Research Paper; Robotics and Automation; Haptic guidance; 3D reconstruction; Colonoscopy; Robotic endoscopic capsule; Vision-based haptic feedback
• ISSN: 2194-6418; 2194-6426
• DOI: 10.1007/s12213-016-0090-2

In this paper, a vision-based haptic feedback system has been proposed with the aim to assist the movement of an endoscopic device during capsule endoscopy (CE) procedures. We present a general system architecture consisting of three modules responsible for vision, haptic guidance and control of movements. The vision module generates 3D local maps as well as local navigation trajectory for endoluminal navigation. The haptic guidance module consists of a haptic device that allows the user to control the movement of the capsule along the generated path. The haptics module also helps the operator by transforming the 3D maps and the relative paths into a guiding virtual force. Measuring the current relative distance between the user input and the maps boundaries, the haptic guidance module will check if the user is moving away or toward the colonic walls and will generate a feedback force with the aim to assist the operator during the navigation procedure. The user will also sense an attractive virtual feedback force toward the generated path that will help the user in the navigation. Finally, the movement control module is the interface between the haptics module and the chosen manipulator. The final goal is to develop a complete active CE robotic platform with haptic feedback in order to enhance safety, to reduce cost (using the same system as a training simulator as well as real endoscopic platform) and to help the operator during the navigation by combining all 3D local maps into a full 3D reconstructed colon.