A method to detect landmark pairs accurately between intra-patient volumetric medical images

• Published in: Medical physics (Lancaster) Vol. 44; no. 11; p. 5859
• Main Authors: Yang, Deshan, Zhang, Miao, Chang, Xiao, Fu, Yabo, Liu, Shi, Li, Harold H, Mutic, Sasa, Duan, Ye
• Format: Journal Article
• Language: English
• Published: United States 01.11.2017
• Subjects: Algorithms; Diagnostic Imaging; Fiducial Markers; Four-Dimensional Computed Tomography; Humans; Image Processing, Computer-Assisted - methods; Image Processing, Computer-Assisted - standards; Phantoms, Imaging; deformable image registration; feature matching; image feature detection; medical image processing; radiation therapy
• ISSN: 2473-4209
• DOI: 10.1002/mp.12526

An image processing procedure was developed in this study to detect large quantity of landmark pairs accurately in pairs of volumetric medical images. The detected landmark pairs can be used to evaluate of deformable image registration (DIR) methods quantitatively. Landmark detection and pair matching were implemented in a Gaussian pyramid multi-resolution scheme. A 3D scale-invariant feature transform (SIFT) feature detection method and a 3D Harris-Laplacian corner detection method were employed to detect feature points, i.e., landmarks. A novel feature matching algorithm, Multi-Resolution Inverse-Consistent Guided Matching or MRICGM, was developed to allow accurate feature pairs matching. MRICGM performs feature matching using guidance by the feature pairs detected at the lower resolution stage and the higher confidence feature pairs already detected at the same resolution stage, while enforces inverse consistency. The proposed feature detection and feature pair matching algorithms were optimized to process 3D CT and MRI images. They were successfully applied between the inter-phase abdomen 4DCT images of three patients, between the original and the re-scanned radiation therapy simulation CT images of two head-neck patients, and between inter-fractional treatment MRIs of two patients. The proposed procedure was able to successfully detect and match over 6300 feature pairs on average. The automatically detected landmark pairs were manually verified and the mismatched pairs were rejected. The automatic feature matching accuracy before manual error rejection was 99.4%. Performance of MRICGM was also evaluated using seven digital phantom datasets with known ground truth of tissue deformation. On average, 11855 feature pairs were detected per digital phantom dataset with TRE = 0.77 ± 0.72 mm. A procedure was developed in this study to detect large number of landmark pairs accurately between two volumetric medical images. It allows a semi-automatic way to generate the ground truth landmark datasets that allow quantitatively evaluation of DIR algorithms for radiation therapy applications.