Marker‐less augmented reality based on monocular vision for falx meningioma localization

• Published in: The international journal of medical robotics + computer assisted surgery Vol. 18; no. 1; pp. e2341 - n/a
• Main Authors: Yi, Zongchao, Deng, Zhen, Liu, Yuqing, He, Bingwei, Huang, Shengyue, Hong, Wenyao, Shi, Jiafeng, Chen, Zhongyi
• Format: Journal Article
• Language: English
• Published: England Wiley Subscription Services, Inc 01.02.2022
• Subjects: Augmented Reality; Brain cancer; camera pose estimation; Cameras; falx meningioma localization; Humans; Imaging, Three-Dimensional; Localization; Markers; Meningeal Neoplasms; Meningioma; Monocular vision; Neuronavigation; registration; Surgery, Computer-Assisted; Tracking devices; Vision, Monocular; augmented reality; registration; camera pose estimation; falx meningioma localization
• DOI: 10.1002/rcs.2341
• ISSN: 1478-5951

Background The existing augmented reality (AR) based neuronavigation systems typically require markers and additional tracking devices for model registration, which causes excessive preparatory steps. Methods For fast and accurate intraoperative navigation, this work proposes a marker‐less AR system that tracks the head features with the monocular camera. After the semi‐automatic initialization process, the feature points between the captured image and the pre‐loaded keyframes are matched for obtaining correspondences. The camera pose is estimated by solving the Perspective‐n‐Point problem. Results The localization error of AR visualization on scalp and falx meningioma is 0.417 ± 0.057 and 1.413 ± 0.282 mm, respectively. The maximum localization error is less than 2 mm. The AR system is robust to occlusions and changes in viewpoint and scale. Conclusions We demonstrate that the developed system can successfully display the augmented falx meningioma with enough accuracy and provide guidance for neurosurgeons to locate the tumour in brain.