Multiplanar analysis for pulmonary nodule classification in CT images using deep convolutional neural network and generative adversarial networks

• Published in: International journal for computer assisted radiology and surgery Vol. 15; no. 1; pp. 173 - 178
• Main Authors: Onishi, Yuya, Teramoto, Atsushi, Tsujimoto, Masakazu, Tsukamoto, Tetsuya, Saito, Kuniaki, Toyama, Hiroshi, Imaizumi, Kazuyoshi, Fujita, Hiroshi
• Format: Journal Article
• Language: English
• Published: Cham Springer International Publishing 01.01.2020; Springer Nature B.V
• Subjects: Artificial neural networks; Classification; Computed tomography; Computer Imaging; Computer Science; Cross-sections; Generative adversarial networks; Health Informatics; Image classification; Image enhancement; Imaging; Medical imaging; Medicine; Medicine & Public Health; Neural networks; Nodules; Pattern Recognition and Graphics; Radiology; Sensitivity analysis; Short Communication; Surgery; Vision; DCNN; CT imaging; Multiplanar analysis; GAN; Pulmonary nodule; Classification
• DOI: 10.1007/s11548-019-02092-z
• ISSN: 1861-6410; 1861-6429

Purpose Early detection and treatment of lung cancer holds great importance. However, pulmonary-nodule classification using CT images alone is difficult to realize. To address this concern, a method for pulmonary-nodule classification based on a deep convolutional neural network (DCNN) and generative adversarial networks (GAN) has previously been proposed by the authors. In that method, the said classification was performed exclusively using axial cross sections of pulmonary nodules. During actual medical-examination procedures, however, a comprehensive judgment can only be made via observation of various pulmonary-nodule cross sections. In the present study, a comprehensive analysis was performed by extending the application of the previously proposed DCNN- and GAN-based automatic classification method to multiple cross sections of pulmonary nodules. Methods Using the proposed method, CT images of 60 cases with confirmed pathological diagnosis by biopsy are analyzed. Firstly, multiplanar images of the pulmonary nodule are generated. Classification training was performed for three DCNNs. A certain pretraining was initially performed using GAN-generated nodule images. This was followed by fine-tuning of each pretrained DCNN using original nodule images provided as input. Results As a result of the evaluation, the specificity was 77.8% and the sensitivity was 93.9%. Additionally, the specificity was observed to have improved by 11.1% without any reduction in the sensitivity, compared to our previous report. Conclusion This study reports development of a comprehensive analysis method to classify pulmonary nodules at multiple sections using GAN and DCNN. The effectiveness of the proposed discrimination method based on use of multiplanar images has been demonstrated to be improved compared to that realized in a previous study reported by the authors. In addition, the possibility of enhancing classification accuracy via application of GAN-generated images, instead of data augmentation, for pretraining even for medical datasets that contain relatively few images has also been demonstrated.