Mixed reality based respiratory liver tumor puncture navigation

• Published in: Computational visual media (Beijing) Vol. 5; no. 4; pp. 363 - 374
• Main Authors: Li, Ruotong, Si, Weixin, Liao, Xiangyun, Wang, Qiong, Klein, Reinhard, Heng, Pheng-Ann
• Format: Journal Article
• Language: English
• Published: Beijing Tsinghua University Press 01.12.2019; SpringerOpen
• Subjects: Artificial Intelligence; Computer Graphics; Computer Science; human computer interaction; Image Processing and Computer Vision; mixed reality; Research Article; statistical motion model; User Interfaces and Human Computer Interaction; mixed reality; human computer interaction; statistical motion model
• ISSN: 2096-0433; 2096-0662
• DOI: 10.1007/s41095-019-0156-x

This paper presents a novel mixed reality based navigation system for accurate respiratory liver tumor punctures in radiofrequency ablation (RFA). Our system contains an optical see-through head-mounted display device (OST-HMD), Microsoft HoloLens for perfectly overlaying the virtual information on the patient, and a optical tracking system NDI Polaris for calibrating the surgical utilities in the surgical scene. Compared with traditional navigation method with CT, our system aligns the virtual guidance information and real patient and real-timely updates the view of virtual guidance via a position tracking system. In addition, to alleviate the difficulty during needle placement induced by respiratory motion, we reconstruct the patient-specific respiratory liver motion through statistical motion model to assist doctors precisely puncture liver tumors. The proposed system has been experimentally validated on vivo pigs with an accurate real-time registration approximately 5-mm mean FRE and TRE, which has the potential to be applied in clinical RFA guidance.