On simulating subjective evaluation using combined objective metrics for validation of 3D tumor segmentation

• Published in: Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention Vol. 10; no. Pt 1; p. 977
• Main Authors: Deng, Xiang, Zhu, Lei, Sun, Yiyong, Xu, Chenyang, Song, Lan, Chen, Jiuhong, Merges, Reto D, Jolly, Marie-Pierre, Suehling, Michael, Xu, Xiaodong
• Format: Journal Article
• Language: English
• Published: Germany 2007
• Subjects: Algorithms; Artificial Intelligence; Computer Simulation; Humans; Imaging, Three-Dimensional - methods; Models, Biological; Neoplasms - diagnostic imaging; Observer Variation; Pattern Recognition, Automated - methods; Radiographic Image Enhancement - methods; Radiographic Image Interpretation, Computer-Assisted - methods; Reproducibility of Results; Sensitivity and Specificity; Tomography, X-Ray Computed - methods
• DOI: 10.1007/978-3-540-75757-3_118

In this paper, we present a new segmentation evaluation method that can simulate radiologist's subjective assessment of 3D tumor segmentation in CT images. The method uses a new metric defined as a linear combination of a set of commonly used objective metrics. The weighing parameters of the linear combination are determined by maximizing the rank correlation between radiologist's subjective rating and objective measurements. Experimental results on 93 lesions demonstrate that the new composite metric shows better performance in segmentation evaluation than each individual objective metric. Also, segmentation rating using the composite metric compares well with radiologist's subjective evaluation. Our method has the potential to facilitate the development of new tumor segmentation algorithms and assist large scale segmentation evaluation studies.