Needle Tip Tracking Based on Optical Imaging and AI

• Published in: IEEE sensors journal Vol. 24; no. 17; pp. 28145 - 28153
• Main Authors: Cheng, Zhuoqi, Sorensen, Simon Lyck Bjaert, Olsen, Mikkel Werge, Eriksen, Rene Lynge, Savarimuthu, Thiusius Rajeeth
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.09.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Accuracy; Algorithms; Artificial neural networks; Bacon; Biomedical imaging; Blood vessels; Coils; Deep learning; Errors; Imaging; Insertion; needle tip tracking (NTT); Needles; Optical fiber sensors; Optical fibers; Optical imaging; optical needle; Real time; scattering imaging; Sensors; Technology assessment; Tracking; Training
• ISSN: 1530-437X; 1558-1748
• DOI: 10.1109/JSEN.2024.3431997

Deep needle insertion to a target often poses a huge challenge, requiring a combination of specialized skills, assistive technology, and extensive training. One of the frequently encountered medical scenarios demanding such expertise includes the needle insertion into a femoral vessel in the groin. Conventionally, deep needle insertion is guided by ultrasound (US) imaging. However, utilizing US for needle tracking demands specialized training and skill to manipulate the probe effectively and interpret the imaging accurately. To address this challenge, this article presents an innovative technology for needle tip real-time tracking. This advancement will be instrumental in facilitating robotic-guided needle insertion toward the identified target. Specifically, our approach revolves around the creation of scattering imaging using an optical fiber-equipped needle and uses convolutional neural network (CNN)-based algorithms to enable real-time estimation of the needle tip's position and orientation during insertion procedures. The efficacy of the proposed technology was rigorously evaluated through three experiments. The first two experiments involved rubber and bacon phantoms to simulate groin anatomy. The positional errors averaging <inline-formula> <tex-math notation="LaTeX">2.3~\pm ~1.5 </tex-math></inline-formula> and <inline-formula> <tex-math notation="LaTeX">2.0~\pm ~1.2 </tex-math></inline-formula>mm, and the orientation errors averaging <inline-formula> <tex-math notation="LaTeX">0.2~\pm ~0.11 </tex-math></inline-formula> and <inline-formula> <tex-math notation="LaTeX">0.16~\pm ~0.1 </tex-math></inline-formula>rad. Furthermore, the system's capabilities were validated through experiments conducted on fresh porcine phantom mimicking more complex anatomical structures, yielding the positional accuracy results of <inline-formula> <tex-math notation="LaTeX">3.2~\pm ~3.1 </tex-math></inline-formula>mm and an orientational accuracy of <inline-formula> <tex-math notation="LaTeX">0.19~\pm ~0.1 </tex-math></inline-formula>rad. Given the average femoral arterial radius of 4-5 mm, the proposed system is demonstrated with a great potential for precise needle guidance in femoral artery insertion procedures. In addition, the findings highlight the broader potential applications of the system in the medical field.