Augmented depth perception visualization in 2D/3D image fusion

• Published in: Computerized medical imaging and graphics Vol. 38; no. 8; pp. 744 - 752
• Main Authors: Wang, Jian, Kreiser, Matthias, Wang, Lejing, Navab, Nassir, Fallavollita, Pascal
• Format: Journal Article
• Language: English
• Published: New York, NY Elsevier Ltd 01.12.2014; Elsevier
• Subjects: 2D/3D registration; Applied sciences; Artificial intelligence; Biological and medical sciences; C-arm fluoroscopy; Cardiovascular system; Coding, codes; Color; Color depth encoding; Computer science; control theory; systems; Computer vision; Depth encoding; Depth perception; Depth Perception - physiology; Exact sciences and technology; Humans; Image processing; Imaging, Three-Dimensional - methods; Information Storage and Retrieval - methods; Information, signal and communications theory; Instruments, apparatus, components and techniques common to several branches of physics and astronomy; Internal Medicine; Intracranial Aneurysm - diagnostic imaging; Investigative techniques, diagnostic techniques (general aspects); Medical sciences; Observer Variation; Occlusion; Other; Pattern Recognition, Automated - methods; Pattern recognition. Digital image processing. Computational geometry; Perception; Physics; Radiographic Image Enhancement - methods; Radionuclide investigations; Reproducibility of Results; Sensitivity and Specificity; Signal and communications theory; Subtraction Technique; Telecommunications and information theory; Three dimensional; Two dimensional; Visualization; X- and γ-ray instruments and techniques; X-ray; X-rays; Depth perception; Visualization; 2D/3D registration; Depth encoding; X-ray; C-arm fluoroscopy; Color depth encoding; Occlusion; Video coding; Image processing; Image coding; Stereopsis; Endoscopic surgery; Image registration; Computer vision; Health staff; X ray radiography; Color; Color image; Depth of field; Operating room; Data visualization; Data fusion; Tridimensional image; Visibility; Occultation
• ISSN: 0895-6111; 1879-0771
• DOI: 10.1016/j.compmedimag.2014.06.015

Highlights • We investigate several concepts enabling improvement of current image fusion visualization. • We propose a contour enhanced visualization to circumvent hidden information in the X-ray. • We implement a new occlusion and depth color-coding algorithm to improve perception in X-ray. • Our occlusion correction provides 100% correctness when determining the position of an aneurysm in X-ray. • The color-coding schemes improve visualization in 2D/3D overlay images.