Endoscopic navigation system with extended field of view using augmented reality technology

• Published in: The international journal of medical robotics + computer assisted surgery Vol. 14; no. 2
• Main Authors: Bong, Jae Hwan, Song, Hyun‐jong, Oh, Yoojin, Park, Namji, Kim, Hyungmin, Park, Shinsuk
• Format: Journal Article
• Language: English
• Published: England Wiley Subscription Services, Inc 01.04.2018
• Subjects: Augmented reality; Computer simulation; Endoscopes; endoscopic skull base surgery; Endoscopy; Field of view; Human performance; Image enhancement; image‐guided surgery; Medical imaging; Navigation systems; Optical tracking; surgical navigation system; Three dimensional models; Tracking systems; image-guided surgery; augmented reality; endoscopic skull base surgery; surgical navigation system
• ISSN: 1478-5951; 1478-596X; 1478-596X
• DOI: 10.1002/rcs.1886

Background While endoscopic skull base surgery (ESBS) has emerged as an alternative surgical option, the limited field of view of the endoscope may lead to the surgeon's fatigue and discomfort. Methods The developed navigation system includes extended augmented reality (AR), which can provide an extended viewport to a conventional endoscopic view by overlaying 3D anatomical models generated from preoperative medical images onto endoscope images. To enhance the accuracy of the developed system, we adopted state‐of‐the‐art endoscopic calibration and tracking techniques based on an optical tracking system. Results The mean spatial errors of AR was ~1 mm, which falls in the acceptable range of accuracy for ESBS. For the simulated surgical tasks with the developed system, the number and duration of error events were decreased. Conclusions The results show that the human subject can perform the task more precisely and safely with the developed AR‐based navigation system than with the conventional endoscopic system.